Multi-aperture imaging device, imaging system and method for capturing an object area

ABSTRACT

Multi-aperture imaging device includes at least one image sensor, an array of juxtaposed optical channels, wherein each optical channel has optics for projecting at least one partial area of an object area on an image sensor area of the image sensor, and a beam deflector for deflecting an optical path of the optical channels in beam-deflecting areas of the beam deflector. The beam deflector is formed as an array of facets arranged along a line-extension direction of the array of optical channels. One facet is allocated to each optical channel. Each facet has a beam-deflecting area. A stray light suppressing structure is arranged between a first beam-deflecting area of a first facet and a second beam-deflecting area of a juxtaposed second facet, which is configured to reduce transition of stray light between the first beam-deflecting area and the second beam-deflecting area.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of copending InternationalApplication No. PCT/EP2017/055329, filed 10 Mar. 2017, which claimspriority from German Application No. 10 2016 204 148.7, filed 14 Mar.2016, which are each incorporated herein in its entirety by thisreference thereto.

BACKGROUND OF THE INVENTION

The present invention relates to a multi-aperture imaging device, to animaging system having at least one multi-aperture imaging device and toa method for capturing an object area. Further, the present inventionrelates to stray light suppression in multi-aperture imaging deviceshaving a linear channel arrangement.

Conventional cameras transmit the total field of view (object area) inone channel and are limited as regards to miniaturization. Insmartphones, two cameras are used that are oriented in and opposite tothe direction of the surface normal of the display. In knownmulti-aperture imaging systems, a contiguous partial object area isallocated to each channel, which is transformed into a contiguouspartial image area.

Individual mirror facets of a beam-deflecting means are used fordividing the field of view and for controlling the viewing direction ofthe individual channels. The mirror facets have a lateral extension thatis large enough for preventing wrong image areas to be transmitted,which are actually allocated to a neighboring channel. However, thisconsequently increases the distance of the channels and results, all inall, to a large extension of the camera along the direction of thechannel arrangement.

Thus, a concept allowing miniaturized devices for capturing a totalfield of view while ensuring high image quality would be desirable.

SUMMARY

According to an embodiment, a multi-aperture imaging device may have: atleast one image sensor; and an array of juxtaposed optical channels,wherein each optical channel has optics for projecting at least onepartial area of an object area on an image sensor area of the imagesensor; beam-deflecting means for deflecting an optical path of theoptical channels in beam-deflecting areas of the beam-deflecting means;wherein the beam-deflecting means is formed as an array of facetsarranged along a line-extension direction of the array of opticalchannels and wherein one facet is allocated to each optical channel andwherein each facet has at least one beam-deflecting area; wherein astray light suppressing structure is arranged between a firstbeam-deflecting area of a first facet and a second beam-deflecting areaof a juxtaposed second facet, which is configured to reduce transitionof stray light between the first beam-deflecting area and the secondbeam-deflecting area.

Another embodiment may have an imaging system with an inventivemulti-aperture imaging device as mentioned above.

According to another embodiment, a method for capturing an object areamay have the steps of: providing an image sensor; projecting an objectarea with an array of juxtaposed optical channels, wherein each opticalchannel has optics for projecting at least one partial area of an objectarea on an image sensor area of the image sensor; deflecting an opticalpath of the optical channels in beam-deflecting areas of abeam-deflecting means that is formed as an array of facets arrangedalong a line-extension direction of the array of optical channels andwherein one facet is allocated to each optical channel and wherein eachfacet has a beam-deflecting area; reducing transition of stray lightbetween a first beam-deflecting area of a first facet and a secondbeam-deflecting area of a second facet by arranging a stray lightsuppressing structure between the first beam-deflecting area and thesecond beam-deflecting area.

A core idea of the present invention is the finding that transition ofstray light between optical channels at the beam-deflecting means canalso be reduced in that stray light suppressing structures are arrangedbetween two facets and between two adjacent beam-deflecting areas ofadjacent facets, respectively, such that the sufficiently large lateralspacing, which can also be considered as safety distance, can beomitted. This allows, while maintaining high image quality, reduction ofa lateral extension of the beam-deflecting means and henceminiaturization of the multi-aperture imaging device.

According to an embodiment, a multi-aperture imaging device comprises atleast one image sensor and an array of juxtaposed optical channels,wherein each optical channel comprises optics for projecting at leastone partial area of an object area on an image sensor area of the imagesensor. The multi-aperture imaging device includes beam-deflecting meansfor deflecting an optical path of the optical channels inbeam-deflecting areas of the beam-deflecting means. The beam-deflectingmeans is formed as an array of facets arranged along a line-extensiondirection of the array of optical channels. One facet is allocated toeach optical channel. Each facet comprises a beam-deflecting area. Astray light suppressing structure is arranged between a firstbeam-deflecting area of a first facet and a second beam-deflecting areaof a juxtaposed second facet, which is configured to reduce transitionof stray light between the first beam-deflecting area and the secondbeam-deflecting area. Here, the reduction relates to a state that wouldbe obtained when the beam-deflecting structure were not arranged.

According to a further embodiment, an imaging system includes amulti-aperture imaging device according to embodiments described herein.The imaging system can, for example, be an apparatus for capturingimages, such as a smartphone, a tablet computer or a mobile musicplayer.

According to a further embodiment, a method for capturing an object areacomprises providing an image sensor, projecting an object area with anarray of juxtaposed optical channels, wherein each optical channelcomprises optics for projecting at least one partial area of an objectarea on an image sensor area of the image sensor. Further, the methodincludes deflecting an optical path of the optical channels inbeam-deflecting areas of a beam-deflecting means that is formed as anarray of facets arranged along a line-extension direction of the arrayof optical channels, and wherein one facet is allocated to each opticalchannel and wherein each facet comprises a beam-deflecting area. Themethod includes reducing transition of stray light between a firstbeam-deflecting area of a first facet and a second beam-deflecting areaof a second facet by arranging a stray light suppressing structurebetween the first beam-deflecting area and the second beam-deflectingarea.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the present invention will be discussed below withreference to the accompanying drawings, in which:

FIG. 1 shows a schematic top view of a multi-aperture imaging deviceaccording to an embodiment including a stray light suppressingstructure;

FIG. 2a shows a schematic top view of a multi-aperture imaging deviceaccording to a further embodiment comprising two optics per opticalchannel including stray light suppressing structures extending along themain side of the beam-deflecting means;

FIG. 2b shows a schematic top view of the multi-aperture imaging deviceof FIG. 2a including stray light suppressing structures extending to anextent of approximately 50% on the main side of the beam-deflectingmeans;

FIG. 3a shows a schematic side-sectional view of a multi-apertureimaging device according to an embodiment further comprising, comparedto the multi-aperture imaging device as illustrated in FIG. 2b , atleast partly transparent covers;

FIG. 3b shows a schematic side-sectional view of the multi-apertureimaging device of FIG. 3a wherein the beam-deflecting means has analtered position;

FIG. 4a shows a schematic side-sectional view of a multi-apertureimaging device according to an embodiment further comprising, comparedto the multi-aperture imaging device, ridges that are arranged betweenstray light suppressing structures;

FIG. 4b shows a schematic top view of a multi-aperture imaging deviceaccording to an embodiment comprising a ridge arranged between straylight suppressing structures;

FIG. 5 shows a schematic view of a concept for projecting a total objectarea or total field of view according to embodiments described herein;

FIG. 6a shows a schematic top view of a section of a multi-apertureimaging device according to an embodiment;

FIG. 6b shows a schematic top view of the multi-aperture imaging deviceaccording to FIG. 6a further comprising an at least partly opaquestructure arranged between the image sensor areas and on the imagesensor in the direction of the object area;

FIG. 6c shows a schematic top view of the multi-aperture imaging deviceof FIG. 6a wherein the optical channels comprise partial area optics;

FIG. 7a shows a schematic top view of an imaging system according to anembodiment;

FIG. 7b shows a schematic top view of a further imaging system accordingto an embodiment which can be considered as a modified variation of theimaging system of FIG. 7 a;

FIG. 8a shows a schematic side-sectional view of a device according toan embodiment in a first operating state;

FIG. 8b shows a schematic side-sectional view of the device of FIG. 8ain a second operating state;

FIG. 9a shows a schematic side-sectional view of a device according to afurther embodiment comprising a cover;

FIG. 9b shows a schematic side-sectional view of the device of FIG. 9ain a second operating state;

FIG. 9c shows a schematic side-sectional view of the device of FIG. 9ain a third position;

FIG. 10a shows a schematic side sectional view of a device according toa further embodiment in the first operating state comprising an at leastpartly transparent cover;

FIG. 10b shows a schematic side sectional view of the device of FIG. 10ain the second operating state;

FIG. 10c shows a schematic side sectional view of the device of FIG. 10awhere a beam-deflecting means is additionally moveable in atranslational manner;

FIG. 11a shows a schematic side sectional view of a device according toan embodiment in the first operating state having a translationallyshiftable cover;

FIG. 11b shows a schematic side sectional view of the device of FIG. 11ain the second operating state;

FIG. 12a shows a schematic side sectional view of a device according toan embodiment where the cover is arranged in a rotationally moveablemanner;

FIG. 12b shows a schematic side sectional view of the device of FIG. 12awhere a travel carriage is translationally moveable;

FIG. 12c shows a schematic side sectional view of the device of FIG. 12ain the second operating state;

FIG. 13a shows a schematic side sectional view of a device according toan embodiment in the first operating state comprising at least partlytransparent covers compared to the device of FIG. 12;

FIG. 13b shows a schematic side sectional view of the device of FIG. 13awherein the beam-deflecting means comprises an intermediate positionbetween a first position and a second position;

FIG. 13c shows a schematic side sectional view of the device of FIG. 13awhere the beam-deflecting means is completely extended out of a housingvolume;

FIG. 13d shows a schematic side sectional view of the device of FIG. 13awhere a distance between the at least partly transparent covers isenlarged compared to FIG. 13a -c;

FIG. 14 shows a schematic perspective view of a device according to anembodiment comprising three multi-aperture imaging devices;

FIG. 15 shows an enlarged perspective view of a section of the device ofFIG. 14;

FIG. 16 shows a schematic perspective view of a device according to anembodiment wherein the beam-deflecting means is connected to themulti-aperture imaging device by means of mounting elements;

FIG. 17a shows a schematic perspective view of a device according to anembodiment in the first operating state with an exemplary shape of acover;

FIG. 17b shows a schematic view of the device of FIG. 17a in the secondoperating state according to an embodiment;

FIG. 17c shows a schematic illustration of an alternative to FIG. 17aaccording to an embodiment;

FIGS. 18a-18c show detailed illustrations of a multi-aperture imagingdevice according to an embodiment;

FIGS. 18d-18f show configurations of the multi-aperture imaging deviceaccording to FIGS. 18a-18c for the case of optics of optical channelsheld by a common carrier according to an embodiment;

FIG. 19 shows the multi-aperture imaging device according to FIG. 18a-cwhich is supplemented, according to an embodiment, by additional meansfor realizing relative movements for optical image stabilization and foradapting the focusing;

FIG. 20a shows a schematic view of a multi-aperture imaging devicearranged in a flat housing according to an embodiment;

FIG. 20b shows a schematic structure of a multi-aperture imaging devicefor stereoscopically capturing a total field of view;

FIG. 21 shows a schematic view of a 3-D multi-aperture imaging deviceaccording to an embodiment;

FIG. 22a shows a schematic view of a further multi-aperture imagingdevice according to an embodiment supplemented, according to anembodiment, by additional means for realizing relative movements forfocus control and optical image stabilization;

FIGS. 22b-22e show schematic side views of a beam-deflecting deviceaccording to an embodiment;

FIG. 23a shows a schematic view of a multi-aperture imaging device withan adjustment means for channel-individual adjustment of opticalcharacteristics according to an embodiment;

FIG. 23b shows a variation of a multi-aperture imaging device with theadjustment means according to an embodiment;

FIG. 24 shows a schematic view of the device of FIG. 22a supplemented byadditional actuators according to an embodiment;

FIG. 25 shows a schematic view of an arrangement of actuators in amulti-aperture imaging device according to an embodiment; and

FIGS. 26a-26f show an advantageous implementation of a beam-deflectingmeans of an imaging device according to an embodiment.

DETAILED DESCRIPTION OF THE INVENTION

Before embodiments of the present invention will be discussed in detailbelow with reference to the drawings, it should be noted that identical,functionally equal or equal elements, objects and/or structures in thedifferent figures are provided with the same reference numbers, suchthat the descriptions of these elements illustrated in the differentembodiments are inter-exchangeable or inter-applicable.

Some of the embodiments described below relate to capturing an objectarea. Other embodiments described below relate to capturing a field ofview. The terms object area/total object area and field of view or totalfield of view are to be considered as inter-changeable below. This meansthat the terms object area, total object area, field of view or totalfield of view are interchangeable without changing the meaning of thestatements herein. To the same extent, the terms partial field of viewand partial object area are interchangeable without changing the meaningof the allocated description.

FIG. 1 shows a schematic top view of a multi-aperture imaging device1000 according to an embodiment. The multi-aperture imaging device 1000can be a device that is configured to capture an object area (field ofview) 27 in the form of several partial object areas (partial fields ofview) 74 a-b. The captured partial object areas 74 a-b can be assembledto a total image by the device 1000 or a downstream computing device,such as a processor, a field programmable gate array (FPGA), a CPU(central processing unit), hardware specific for the method, such as anASIC or the same. According to embodiments, the object area 72 isscanned by a plurality of partial object areas 74 a-b. The plurality canbe at least 2, at least 3, at least 5, at least 9 or higher.

The multi-aperture imaging device 1000 includes an image sensor 12 andan array 14 of juxtaposed optical channels 16 a and 16 b. Each opticalchannel 16 a and 16 b comprises optics 64 a and 64 b, respectively, forprojecting at least one partial area 74 a or 74 b on an image sensorarea of the image sensor 12. The multi-aperture imaging device 1000includes a beam-deflecting means 18. The beam-deflecting means 18 isconfigured to deflect optical paths 17 a and 17 b of the opticalchannels 16 a and 16 b. For this, the beam-deflecting means comprisesfacets 68 a and 68 b. In other words, the beam-deflecting beams 18 isformed as an array of facets 68 a-b. The facets 68 a and 68 b arearranged along a line-extension direction 146, wherein theline-extension direction 146 relates to a direction along which theoptical channels 16 a and 16 b are arranged in the array 14, i.e., infront of the image sensor.

One facet 68 a and 68 b, respectively, is allocated to each opticalchannel 16 a and 16 b. As will be described below, several optical pathscan be allocated to one facet 68 a or 68 b. The facet 68 a is configuredto deflect the optical path 17 a of the optical channel 16 a in abeam-deflecting area 1002 a towards the partial area 74 a. In the sameway, the facet 68 b is configured to deflect the optical path 17 b ofthe optical channel 16 b in a beam-deflecting area 1002 b of the facet68 b towards the partial area 74 b. This means that each facet 68 a and68 b comprises a beam-deflecting area 1002 a and 1002 b. Thebeam-deflecting area 1002 a or 1002 b can be a surface area of the facet68 a and 68 b, respectively, which is configured to deflect therespective optical path.

A stray light suppressing structure 1004 is arranged between thebeam-deflecting areas 1002 a and 1002 b, which is configured to reduceor prevent transition of stray light between the first beam-deflectingarea 1002 a and the second beam-deflecting area 1002 b. Advantageously,the stray light suppressing structure 1004 comprises an at least partlyopaque material. It is further of advantage that the stray lightsuppressing structure 1004 comprises a topography that is elevated withrespect to a topography of the first facet 68 a and/or the second facet68 b. The topography can mean a surface profile considering elevationsand/or curvatures of the facets 68 a and 68 b as well as the stray lightsuppressing structure 1004 with respect to adjacent structures. Simplyput, the stray light suppressing structure 1004 can be elevated at leastin parts between the facet 68 a and/or the facet 68 b.

According to an embodiment, the stray light suppressing structure 1004is a partition wall that is arranged between the facets 68 a and 68 b.Scatterings in the optical paths 17 a and/or 17 b that wouldunintentionally enter the beam-deflecting area 1002 a or 1002 b of theadjacent optical channel 16 a and 16 b, respectively, when the straylight suppressing structure is absent, can be at least partlyintercepted by the stray light suppressing structure 1004, such thatimage quality is merely effected to a limited extent or even not at allby stray light transition. This allows the reduction of distancesbetween the beam-deflecting areas that would be used when the straylight suppressing structures 1004 a or 1004 b are absent in order toreduce stray light transition.

In other words, structures for reducing and/or preventing stray lightcan be arranged at the transitions of individual facets of thebeam-deflecting means.

FIG. 2a shows a schematic top view of a multi-aperture imaging device2000 including the image sensor 12, the array 14 and the beam-deflectingmeans 18. Each optical channel 16 a-c comprises, for example, two optics(lenses) 64 a and 64 b, 64 c and 64 d or 64 e and 64 f in order toinfluence an optical path 17 a-c of the respective optical channel 16a-c, and to direct the same to an image sensor area 58 a-c. According toembodiments, an optical channel can have any number of lenses, such asone, two or more than two. The optical channels 16 a-c can have adiffering number of lenses. A stray light suppressing structure 1004 ais arranged between the beam-deflecting area 1002 a of the facet 68 aand the beam-deflecting area 1002 a of the facet 68 b. A stray lightsuppressing structure 1004 b is arranged between the beam-deflectingarea 1002 b and the beam-deflecting area 1002 c of the facet 68 c of thebeam-deflecting means 18.

A main side of the beam-deflecting means 18 and the individual facets 68a-c can be projected on a plane that is spanned by the line-extensiondirection 146 and a direction 1006 that is arranged perpendicular to theline-extension direction 146. The spanned plane can, for example, beessentially perpendicular to the image sensor areas 58 a-c. Theline-extension direction 146 can be arranged parallel to an axialextension of the beam-deflecting means 18, while the direction 1006 canbe referred to as lateral extension direction of the beam-deflectingmeans 18. The stray light suppressing structures 1004 a and/or 1004 bcan be arranged along the entire extension of the beam-deflecting means18 parallel to the direction 1006, i.e. to an extent of up to 1006,wherein also projections of the stray light suppressing structuresbeyond the beam-deflecting means 18 are possible. This allowssuppression of stray light transitions between two adjacentbeam-deflecting areas 1002 a and 1002 b, and 1002 b and 1002 c,respectively, across the entire extension of the beam-deflecting means18 along the direction 1006.

FIG. 2b shows a schematic top view of the multi-aperture imaging deviceof FIG. 2a , wherein the stray light suppressing structures 1004 a and1004 b extend to an extent of approximately 50% on the main side of thebeam-deflecting means 18 and along the direction 1006. The stray lightsuppressing structures 1004 a and/or 1004 b can be arranged, forexample, starting on a side of the main side of the beam-deflectingmeans 18 facing away from the optics 64 a-f towards the optics 64 a-fand can extend across an area of approximately 50% along the direction1006. According to further embodiments, the stray light suppressingstructure extends to an extent of at least 10%, at least 20% or at least30% along the direction 1006. According to further embodiments, thestray light suppressing structures 1004 a and/or 1004 b can be arrangedspaced apart from lateral edges of the beam-deflecting means 18, i.e.can be essentially arranged in a central area of the beam-deflectingareas 1004 a-c. According to an embodiment as described in the contextof FIG. 2a , the extension of the stray light suppressing structurealong the direction 1006 can also be at least 50%, at least 70%, atleast 90%, or at least 95%. It is also possible that the stray lightsuppressing structure 1004 a or 1004 b extends along an arbitrary areaalong the direction 1006, wherein the stray light suppressing structureis elevated only in parts with respect to a topography of the adjacentfacets 68 a and 68 b, and 68 b and 68 c, respectively, i.e. theelevation (topography) is approximately zero within areas, which alsoincludes negative values.

The stray light suppressing structures between two juxtaposed facets 68a-c according to embodiments described herein may be formed of at leastone opaque material. For this, a metal material, a plastic materialand/or a semiconductor material can be provided. Here, thecharacteristic of the stray light suppression may relate to a usefulwavelength range of the multi-aperture imaging device. In that way, forexample, usage of semiconductor material for the stray light suppressingstructures can be advantageous when the multi-aperture imaging device isconfigured to capture images in a visible wavelength range. In contrast,when capturing images in an infrared wavelength range, usage of metalmaterial can be of advantage when semiconductor material becomestransparent within this wave range.

FIG. 3a shows a schematic side sectional view of a multi-apertureimaging device 3000 which further comprises, compared to themulti-aperture imaging device 2000 as illustrated in FIG. 2b , at leastpartly transparent covers 36 a and 36 b. The at least partly transparentcovers 36 a and 36 b can, for example, be part of a housing in which themulti-aperture imaging device 3000 is arranged. The beam-deflectingmeans 18 can be configured to deflect optical paths of the opticalchannels in dependence on a relative position of the beam-deflectingmeans 18 with respect to the image sensor 12 through the transparentcover 36 a or the transparent cover 36 b. As will be described below indetail, depending on the position of the beam-deflecting means 18, adiffering object area can be captured by the multi-aperture imagingdevice 3000. In this regard, the at least partly transparent cover 36 aand 36 b, respectively, allows protection of the multi-aperture imagingdevice 3000 from external influences, such as contamination ormechanical influences. In order to be movable between the first andsecond positions, the beam-deflecting means 18 can, for example, bemovable via an axis of rotation 44.

The stray light suppressing structure 1004 a is arranged between thebeam-deflecting areas of the facets 68 a and 68 b. The stray lightsuppressing structure 1004 a is, for example, merely arranged on a firstmain side 1008 a of the beam-deflecting means 18. Thus, in theillustrated perspective, the lateral edge of the facet 68 b can be seen.On an opposite second main side 1008 b of the beam-deflecting means 18,a further stray light suppressing structure 1004 c can be arrangedbetween the beam-deflecting areas of the facets 68 a and 68 b, in orderto be effective during a second subsequently described position of thebeam-deflecting means 18. Thus, the main sides 1008 a and 1008 b can bereflective.

In the illustrated cross-section, the stray light suppressing structure1004 a can have a polygonal topography. This can also be considered suchthat the stray light suppressing structure 1004 a has a cross-section ina polygonal shape. This means that the stray light suppressing structure1004 a can have any cross-section which can be assembled of any straightor bent segments arranged arbitrarily with respect to one another. Aportion 1002 a of the stray light suppressing structure 1004 a can bearranged such that the same is arranged in the illustrated firstposition essentially parallel to a surface of the at least partlytransparent cover 36 a facing the beam-deflecting means 18. This allowssimultaneously a high stray light suppression and a short distancebetween the at least partly transparent cover 36 a and the stray lightsuppressing structure 1004 a, such that an extension of themulti-aperture imaging device 3000 along a direction 1014 which can bearranged perpendicular to the line-extension direction and perpendicularto the direction 1006 described in FIG. 2b is low or even at a minimum.The extension of the multi-aperture imaging device 3000 in the direction1014 can also be considered as installation height, wherein it isobvious that the term height, depending on the position of themulti-aperture imaging device 3000 in space, is also mutuallyexchangeable with other terms like length or width and is hence not tohave any limiting effect in the context of embodiments described herein.

FIG. 3b shows a schematic side sectional view of the multi-apertureimaging device 3000, wherein the beam-deflecting means 18 is in thesecond position where the same deflects the optical paths of the opticalchannels through the at least partly transparent cover 36 b. The straylight suppressing structure 1004 c is arranged, for example, on thesecond main side 1008 b opposite to the stray light suppressingstructure 1004 a. The stray light suppressing structure 1004 c can havea portion 1012 b that is arranged parallel to a surface of the at leastpartly transparent cover 36 b facing the beam-deflecting means 18 whenthe beam-deflecting means 18 is in the second position.

Although the stray light suppressing structures 1004 a and 1004 c of themulti-aperture imaging device 3000 have been described such that thesame are respectively arranged on a main side of the beam-deflectingmeans 18 on the same facet, according to further embodiments, theopposite stray light suppressing structures 1004 a and 1004 c can alsobe arranged on different facets. For example, the stray lightsuppressing structure 1004 a can be arranged on the facet 68 a and thestray light suppressing structure 1004 c on the facet 68 b, or viceversa. According to further embodiments, the stray light suppressingstructures 1004 a and 1004 c can also be formed integrally and can, forexample, project through a surface of the facet 68 a or 68 b. It is alsopossible that the beam-deflecting means 18 comprises areas between twofacets through which a stray light suppressing structure projectstowards both main sides of the beam-deflecting means 18.

Above, the portions 1012 a and 1012 b of the stray light suppressingstructure 1004 a and 1004 b, respectively, have been described such thatthe same are parallel to the at least partly transparent covers 36 a and36 b, respectively, when the beam-deflecting means 18 is in therespective position. It is possible to reduce the distance between theportion 1012 a and the at least partly transparent cover 36 a to 0, i.e.mechanical contact takes place. However, it is advantageous to maintaina distance between both components, the stray light suppressingstructure 1004 a and the at least partly transparent cover 36 a, inorder to prevent mechanical interaction, i.e. abutting or mutualapplication of forces. This means that, in the first position, the straylight suppressing structure 1004 a is arranged spaced apart(contactless) from the at least partly transparent cover 36 a and hencefrom the housing of the multi-aperture imaging device 3000. The sameapplies to the portion 1012 b of the stray light suppressing structure1004 b with regard to the at least partly transparent cover 36 b in thesecond position of the beam-deflecting means 18.

Although the multi-aperture imaging device 3000 has been described suchthat the facets 68 a and 68 b each have two reflective beam-deflectingareas on respectively one main side of the beam-deflecting means 18,this can also be considered such that opposite to the facet 68 a afurther facet is arranged comprising the beam-deflecting area arrangedopposite to the beam-deflecting area of the facet 68 a. Simply put, thismeans that a facet having two opposite beam-deflecting areas can also beconsidered as two opposite facets. While the beam-deflecting means hasbeen described such that the same can be moved rotationally between thefirst position and the second position, according to furtherembodiments, the same can also be shifted translationally, i.e. parallelto the axis of rotation 34 and can comprise respectively differentlyoriented facets deflecting, depending on the position, the optical pathin the first direction or in the second direction.

As will be described below in more detail, switchable diaphragms can bearranged on the at least partly transparent covers 36 a and/or 36 b,which are configured to prevent, at least at times, entry of lighttowards the image sensor in order to further increase the image quality.

In other words, the stray light suppressing structure 1004 a and/or 1004b can be structured such that, in the first position of thebeam-deflecting means, an edge, the portion 1012 a, is oriented mostlyparallel to the cover glass (at least partly transparent cover 36 a)through which the optical path passes. In the second position of thebeam-deflecting means, a second edge, the portion 1012 b, can bearranged that is oriented almost parallel to the other cover glass, theat least partly transparent cover 36 b. The further shaping of the straylight suppressing structure 1004 a and/or 1004 b can be configured suchthat maximum screening of the optical path within an imaging channel(optical channel) is obtained, but at the same time none of the coverglasses is touched when rotating the beam-deflecting means.

FIG. 4a shows a schematic side sectional view of a multi-apertureimaging device 4000 further comprising, compared to the multi-apertureimaging device 3000, ridges 1014 a and 1014 b that are arranged betweenstray light suppressing structures. With reference to FIG. 2a , forexample, the stray light suppressing structures 1004 a and 1004 b can beconnected by the ridge 1014 a. The ridge can comprise a materialallowing a certain mechanical stability between the adjacent stray lightsuppressing structures 1004 a and 1004 b. This can, for example, be asemiconductor material, a plastic material and/or a metal material. Inone embodiment, the ridge 1014 can be integrally formed with the straylight suppressing structures arranged thereon. In one embodiment, theridge 1014 a is arranged on an edge of the stray light suppressingstructures and/or the beam-deflecting means 18 pointing towards theoptics 64 a and 64 b. This can also be considered such that in someembodiments the ridge is not arranged on other edges. When switching thebeam-deflecting means from the first position to the second positionaround the axis of rotation, this enables that no additionalinstallation height or distance between the at least partly transparentcovers 36 a and 36 b is needed, i.e. no additional installation heightis needed. This allows further that a facet of the beam-deflecting means18 is surrounded by stray light suppressing structures in areas on threesides that might not relate to the side facing away from the optics.

The arrangement of a ridge allows simplified production of themulti-aperture imaging device 4000 and/or simplified assembly of thestray light suppressing structures on the beam-deflecting means 18.

In other words, the ridge can have a specific thickness in order to bemechanically stable. An exemplary thickness is, for example, in a rangeof at least 100 μm and at the most 10 mm, of at least 200 μm and at themost 1 mm or of at least 300 μm and at the most 500 μm, which providessufficiently great stability, but does not result in unnecessaryenlargement of the installation height of the device. The ridge ispossibly arranged only on the side facing the optics since this does notresult in any or only a slight enlargement of the installationheight/thickness of the multi-aperture imaging device 3000. However, itis possible to arrange the ridge also on the side of the facet facingaway from the optics, but this may result in a greater enlargement ofthe installation height/thickness, and also, vignetting (shading towardsthe image edge) of the imaging optical path can be obtained, which isundesirable. The beam-deflecting means can be changed as regards to itsorientation such that the viewing direction of the camera is oriented atleast towards the front and towards the back, which relates, forexample, to the surface of an imaging system, for example a mobilephone.

The beam-deflecting means is configured to deflect the optical path 17of optical channels between the object area and the image sensor 12 andthe array including the optics 64 a and 64 b. As described in thecontext of FIG. 3a-b , the beam-deflecting means can have variablepositions or orientations in order to deflect the optical path betweenvariable object areas and the image sensor 12. Between the optics areaand the beam-deflecting means 18, the optical path 17 passes through anexit area of the multi-aperture imaging device, for example the at leastpartly transparent cover 36 a and 36 b, respectively, or an opening inthe housing.

In the first orientation or position of the beam-deflecting means 18,the ridge 1014 a facing the lenses is arranged, with respect to thecentral optical path 17 of the imaging channel 16 a, below opticalcenters of the lenses 64 a and 64 b as illustrated in FIG. 4a .According to further embodiments, tilting of the beam-deflecting means18 can also be performed such that the ridge 1014 a is below the lenses64 a and 64 b. The term “below” relates, for example, to the fact thatin the illustrated orientation the illustrated optical path 17 and theviewing direction of the optical channel 16 a passes between the atleast partially transparent cover 36 a (exit side of the multi-apertureimaging device through which the optical path 17 passes) and the ridge1014 a. The term “below” is not to have any limiting effect as regardsto the orientation in space, but is merely to serve illustrationpurposes. This allows that the ridge 1014 a has no influence on theprojection of the partial area of the object area since the same isarranged outside the optical path 17. Hence, the same is not seen by themulti-aperture imaging device 4000′. In a second orientation or positionof the beam-deflecting means 18 as illustrated, for example in FIG. 3b ,the ridge 1014 b facing the lenses is arranged above the lenses 64 a and64 b and is not seen. In this context, this can be considered such thatin the second orientation the optical path 17 and the viewing directionof the optical channel 16 a, respectively, passes between the at leastpartly transparent cover 36 b (exit side of the multi-aperture imagingdevice 4000′) and the ridge 1014 b. The term “above” is in this contextalso to be considered only illustratively, without having a limitingeffect with regards to the spatial orientation top/bottom/left/right.

Such an arrangement prevents that a ridge 1014 a or 1014 b arranged onthe side facing away from the lenses, for example on the portion 1012 isseen or captured in any of the two positions or results in shadings inthe image. Such an effect could be prevented when the thickness orinstallation height of the structure is increased by at least the ridgethickness, which would result, however, in an increased installationheight of the multi-aperture imaging device 4000′ which would bedisadvantageous.

The beam-deflecting means can have reflective facets comprisingmirroring areas both on the top and bottom. Cover glasses provided withapertures can be mounted above and below the beam-deflecting means.

FIG. 4b shows a schematic top view of a multi-aperture imaging device4000′ which can also be considered as modified multi-aperture imagingdevice of FIG. 2a . Compared to the multi-aperture imaging device 2000,the multi-aperture imaging device 4000′ comprises a ridge 1014. If, forexample, the stray light suppressing structures 1004 a and 1004 b areeffective for both main sides of the beam-deflecting means 18, asdescribed in the context of FIG. 4a , the arrangement of only one ridgecan result in sufficient mechanical stability. The individual ridge canbe arranged on one of the two main sides. Alternatively, the ridge 1014can also be arranged on both main sides, for example in that the same isbuilt around a main side edge of the beam-deflecting means 18. The ridge1014 and the stray light suppressing structures 1004 a-d can bestructured integrally. For example, stray light suppressing structuresarranged on one or two main sides of the beam-deflecting means can beconnected to one another by means of the ridge 1014 and can be arrangedon the beam-deflecting means 18 as a common component.

FIG. 5 shows a schematic top view of a concept for imaging a totalobject area or total field of view according to embodiments describedherein. A multi-aperture imaging device 5000 includes, for example, fouroptical channels 16 a-d each imaging a partial area of the total fieldof view. Channel-individual deflection of the optical path 17 a in pairscan, for example, be obtained by facets 68 a-b of the beam-deflectingmeans 18 that are differently inclined with respect to one another. Theoptical channels 16 a-d can have inclined optical axes, such that thefacets 68 a and 68 b can be shared by several channels. Tilting thefacets can be performed along an angular component (orthogonally to aline-extension direction of the optical channel 16 a-d) which can resultin a simplification of the beam-deflecting means 18.

FIG. 6a shows a schematic top view of a section of a multi-apertureimaging device 6000. The multi-aperture imaging device 6000 includes animage sensor 12 and an array 14 of juxtaposed optical channels 16 a and16 b each including optics 64 a and 64 b, respectively. This means thateach optical channel 16 a and 16 b comprises optics 64 a and 64 b,respectively, for projecting at least one partial area 74 a-c of theobject area 26 on an image sensor area 58 a, 58 b and 58 c, respectivelyof the image sensor. In that way, optics 64 a projects, for example, thepartial area 74 a on the image sensor area 58 a, which is illustrated bythe optical path 17 a. Further, the optics 64 a projects the partialarea 74 b on the image sensor area 58 b which is illustrated by theoptical path 17 b. The partial areas 74 a and 74 b are disjoint in theobject area 26, this means the same do not overlap and/or are completelydifferent.

The limitation of the partial field of view of each optical channel 16a-b combined with the beam-deflecting means 18 can result in a reductionof an installation height (primary effect) of the multi-aperture imagingdevice 1000. This is obtained in that the installation height isrealized perpendicular to the viewing direction of the multi-apertureimaging device. Additionally, simplification of the optics of eachchannel is obtained since fewer lenses can be arranged per channel,since for capturing a partial field of view a simpler correction offield aberrations is possible (secondary effect).

The optics 64 b of the optical channel 16 b is configured to project thepartial area 74 c on the image sensor area 58 c as illustrated by theoptical path 17 c. The partial area 74 c overlaps with the partial area74 a and/or 74 b, such that by image processing of the partial images ofthe image sensor areas 58 a, 58 b and 58 c, a total image of the objectarea 26 can be obtained. Alternatively, the optical channel 16 b canalso be configured comparably to the optical channel 16 a; this meansinfluencing two optical paths such that two disjoint partial areas ofthe object area are directed to two image sensor areas.

The multi-aperture imaging device 6000 comprises the optionalbeam-deflecting means 18 that is configured to deflect an optical pathof the optical channels 16 a and 16 b such that the same are directedtowards the object area 26. The optical paths 17 a, 17 b and 17 c canrun oblique to one another in a common plane between the image sensorareas 58 a-c and the optional beam-deflecting means 18. This means theviewing directions of the optical channels and the optical paths,respectively, can differ and can be in a common plane. By deflection bythe beam-deflecting means 18, a viewing direction along a seconddirection can be changed, such that by deflecting the optical paths aplurality of partial areas of the object area 26 distributedtwo-dimensionally to one another can be captured. According to furtherembodiments, further optical channels can be arranged beside the opticalchannels 16 a and 16 b. Alternatively or additionally, further partialareas of the object area are projected on further (not illustrated)image sensor areas of the image sensor 12 by the optics 64 a, whereinthe partial areas are each disjoint from one another. The furtherpartial areas can be offset to the partial area 74 a along the direction142 and/or the direction 144. The beam-deflecting means 18 can deflectthe optical paths 17 a and 17 b such that the respective partial areasin the object area are no longer disjoint from one another.Advantageously, however, the partial areas remain disjoint even afterdeflection of the optical paths.

Simply put, the optical paths 17 a and 17 b, oriented obliquely to oneanother, allow a lateral offset of the partial object areas 74 a and 74b to one another. Implementation of the multi-aperture imaging device1000 can now be performed such that the partial object areas 74 a and 74b, as illustrated, are offset to one another along a first direction 142in the object area 26. Alternatively or additionally, it is alsopossible that the partial object areas 74 a and 74 b are laterallyoffset to one another along a second direction 144 in the object area26, wherein both offset directions can also be combined. Directions 142and 144 can be, for example, parallel to image axes of an image to becaptured or that has been captured. This means that partial areas 74 a-cthat are two-dimensionally offset to one another can also be obtainedwithout beam-deflecting means 18.

While the image sensor 12 is illustrated such that the same includesimage sensor areas 58 a, 58 b and 58 c, multi-aperture imaging devicesaccording to further embodiments comprise at least two, three or moreimage sensors, all in all providing a total amount of image sensor areas58 a, 58 b and 58 c. The total amount can be any number of image sensorareas, such as at least three, at least six or at least nine. Thus, animage sensor can include merely one or several image sensor areas 58a-c. The multi-aperture imaging device can include one or several imagesensors.

In the areas between the image sensor areas 58 a-c, non-light-sensitiveintegrated circuits, electronic components (resistors, capacitors)and/or electric connecting elements (bonding wires, vias) or the samecan be arranged.

Optionally, the optical channels 16 a and 16 b can be at least partlyinsulated from at least partly opaque structures 1016 a-c of adjacentoptical channels and/or an environment of the optical channel in orderto at least partly prevent entry of stray light into the optical channel16 a or 16 b and to obtain a quality of a captured image.

In other words, a multi-aperture imaging device can include severalimaging channels (optical channels), each transmitting a partial area ofthe object area, wherein the partial areas partly cover or overlap eachother and at least one of the optical channels projects at least twonon-contiguous object areas. This means that there is a gap in the imageof this channel. A number or total number of the optical channels mighttransmit the total field of view completely.

FIG. 6b shows a schematic top view of a multi-aperture imaging device6000 further comprising an at least partly opaque structure 1018 a whichis arranged between the image sensor areas 58 a and 58 b on the imagesensor in the direction of the object area. The at least partly opaquestructure 1018 a can include a semiconductor material, a glass, ceramicor glass ceramic material, a plastic material and/or a metal materialand can be at least partly opaque in a wavelength range where images arecaptured by the multi-aperture imaging device 6000. In that way, forexample in an infrared capturing, a plastic material or metal materialcan be advantageous compared to a semiconductor material when thesemiconductor material is transparent for infrared radiation.Alternatively, for wavelengths in the visible range, a semiconductormaterial or plastic material can be advantageous compared to a metalmaterial since the metal material can possibly cause higher productioneffort, higher weight and/or higher costs.

The at least partly opaque structure 1018 a allows suppression of straylight between the image sensor areas 58 a and 58 b, i.e. crosstalkbetween the partial images of an optical channel is reduced. In a sameor similar manner, the optical channel 16 c comprises an at least partlyopaque structure 1018 b which can be formed in the same or similarmanner as the at least partly opaque structure 1018 a.

The at least partly opaque structures 1018 a and 1018 b can have aconstant or a variable cross-section. The cross-section can beconsidered as dimension along a line-extension direction 146. Theline-extension direction 146 can be a direction along which the opticalchannels in the array 14 are arranged and/or can run parallel to theimage sensor 12. The at least partly opaque structures 1018 a and 1018 bare arranged on or adjacent to the image sensor 12. In the directiontowards the array 14, the cross-section of the at least partly opaquestructures 1018 a and 1018 b tapers. This allows a geometry of the atleast partly opaque structures 1018 a and 1018 b that is adapted to theoptical paths 17 a and 17 b and 17 d and 17 e, respectively. Thus, theat least partly opaque structures 1018 a and 1018 b are arranged betweenthe image sensor areas of the image sensor 12 and allow improved channelseparation between the optical channels 16 a-d and between the imagesensor areas. In the areas behind the at least partly opaque structures1004 a and 1004 b between the image sensor areas 58 a-c,non-light-sensitive integrated circuits, electronic components(resistors, capacitors) and/or electric connecting elements (bondingwires, vias) or the same can be arranged.

FIG. 6c shows a schematic top view of the multi-aperture imaging device6000 where the optical channels 16 a and 16 c comprise partial areaoptics 1022 a-1022 d. The partial area optics 1022 a-d can, for example,be lenses, refractive or diffractive elements, each allocatedexclusively to one partial area. Thus, for example the partial areaoptics 1022 a is configured to influence the optical path 17 a and tonot influence the optical path 17 b. The optical path 17 a can be usedfor projecting, for example, the partial area 74 a as described in thecontext of FIG. 1. The partial area optics 1022 b can be configured toinfluence the optical path 17 b that projects, for example, the partialarea 74 b. The partial area optics 1022 b is configured to not influencethe optical path 17 a. Alternatively, the optical channel 16 a cancomprise merely one of the partial area optics 1022 a or 1022 b and/orfurther partial area optics merely allocated to the optical path 17 a or17 b. The partial area optics 1022 a and/or 1022 b can, for example, bemechanically fixed to the at least partly opaque structure 1018 a.Alternatively or additionally, the partial area optics 1022 a can bemechanically fixed to the structure 1018 a or 1016 a. In the same way,the partial area optics 1022 b can be mechanically fixed to thestructure 1018 b and/or 1016 b. According to an alternative embodiment,partial area optics 1022 a and/or 1022 b can be mechanically connectedto the optics 64 a and suspended via the same with respect to the imagesensor. According to a further embodiment, the optics 64 a can bemechanically connected to the partial area optics 1022 a and/or 1022 band be suspended via the same with respect to the image sensor 12.

The partial area optics 1022 a can, for example, be produced as roofprism. The partial area optics 1022 a and 1022 b can, for example, alsobe two parts of a roof prism which is divided into two parts and/ormirror-symmetrical. The roof prism can, for example, bemirror-symmetrical to the plane 1024.

The partial area optics 1022 c and 1022 d can each also be exclusivelyallocated to one partial area and influence a projection of the same ona respective image sensor area. If an optical channel 16 a or 16 ccomprises two partial area optics 1022 a and 1022 b and 1022 c and 1022d, respectively, the two partial area optics can be structuredidentically. The partial area optics 1022 a and 1022 b can, for example,be arranged mirror-symmetrically around a symmetry plane 1024.

The symmetry plane 1024 can be arranged in space such that the sameincludes an optical axis 1026 of the optics 64 a shared by the partialarea optics 1022 a and 1022 b and running perpendicular to theline-extension direction 146 of the array 14. Although the symmetryplane 1024 and the axis 1026 are not shown congruently to one another inFIG. 7c , the plane 1024 and the axis 1026 are congruent, since theplane 1024 includes the axis 1026. The non-congruent illustration merelyserves for a better illustration. According to an embodiment, the optics64 a is configured such that an imaging function of the optics 64 a isrotationally symmetrical with respect to a main viewing direction of theoptics 64 a or mirror-symmetrical with respect to the symmetry plane1024. This allows the optical paths 17 a and 17 b to be symmetricallyinfluenced by the optics 64 a.

The mirror-symmetrical arrangement or implementation of the partial areaoptics 1022 a and 1022 b allows symmetrical influencing of the opticalpaths 17 a and 17 b such that the optics 64 a can also be configuredsymmetrically. This allows, for example, symmetrical deflection orinfluencing the optical paths towards symmetrically distributed partialobject areas. The multi-aperture imaging device 7000 can also beconfigured such that the optics 64 a is not mirror-symmetrical, forexample when irregular distribution of the partial areas within theobject area is intended. According to alternative embodiments, thepartial area optics 1022 a and 1022 b can also be asymmetrical withregard to the plane 1024, for example when unsymmetrical or asymmetricaldistortion of the two optical paths 17 a and 17 b is intended.

In other words, the separating structures 1018 a and 1018 b taperbetween the partial areas in the direction towards the object. Theseparating structures (at least partly opaque structures) 1018 a and1018 b can be configured symmetrically to the optical axis 1026. Lensescan be arranged, for example the partial area optics 1022 a and 1022 bthat are each used only by one partial area. These lenses can beidentical and/or can be arranged mirror-symmetrically to the opticalaxis 1026 with regard to their optical characteristic. Further,rotational symmetry might not be implemented.

The partial area optics 1022 a-d can be configured in several layers,i.e. in several planes and can hence each consist of more than only onelens, a refractive or diffractive surface. Optics 16 a and 16 c can alsobe configured in a multilayered manner and can hence consist of morethan only one lens, a refractive or diffractive surface.

FIG. 7a shows a schematic top view of an imaging system 7000 comprisinga first multi-aperture imaging device 1000 a and a second multi-apertureimaging device 1000 b. Alternatively or additionally, the imaging system7000 can comprise a different multi-aperture imaging device describedherein, such as the multi-aperture imaging device 2000, 3000, 4000, 5000or 6000. The multi-aperture imaging system can be implemented, forexample, as mobile phone, smartphone, tablet or monitor.

The multi-aperture imaging devices 1000 a and 1000 b can each bereferred to as module. Each of the modules can be configured andarranged to capture the total field of view completely or almostcompletely such that the imaging system 7000 is implemented to capturethe total field of view stereoscopically by modules 1000 a and 1000 b.This means the imaging system 7000 comprises, for example a stereostructure. According to further embodiments, an imaging system comprisesfurther additional modules, such as triple structures, quadruplestructures or higher order structures result.

FIG. 7b shows a schematic top view of an imaging system 7000′, which canbe considered as a modified variation of the imaging system 7000. Themodules 1000 a and 1000 b can comprise a common image sensor 12.Alternatively or additionally, the modules 1000 a and 1000 b cancomprise a common beam-deflecting means 18. Alternatively oradditionally, the modules 1000 a and 1000 b can comprise a common array14 of juxtaposed optical channels 16. According to further embodiments,the imaging system can also comprise other common components. This can,for example, be a common focusing means including at least one actuatorfor commonly adjusting a focus of the first and second multi-apertureimaging devices. Alternatively or additionally, it can be an opticalimage stabilizer having a joint effect for at least one optical path ofthe first multi-aperture imaging device and for at least one opticalpath of the second multi-aperture imaging device for image stabilizationalong a first image axis and a second image axis by generating atranslational relative movement between the image sensor and the arrayor the beam-deflecting means of the first or second multi-apertureimaging devices. Alternatively or additionally, it can be an opticalimage stabilizer having a joint effect for the at least one optical pathof the first multi-aperture imaging device and for the at least oneoptical path of the second multi-aperture imaging device, wherein theoptical image stabilizer is configured to generate, for imagestabilization along a first image axis, a translational relativemovement between the image sensor and the array and, for imagestabilization along a second image axis, a rotational movement of thebeam-deflecting means of the first multi-aperture imaging device or thebeam-deflecting means of the second multi-aperture imaging device. Thesecomponents will be discussed in more detail below. In other words, themodules can be contiguous and can result in a single common module.

In the following, reference is made to devices including at least onemulti-aperture imaging device. The devices can be imaging systems thatare configured to image the object area by means of the at leastmulti-aperture imaging device. The multi-aperture imaging device asdescribed below, can, for example, the multi-aperture imaging device1000, 2000, 3000, 4000, 5000 or 6000.

FIG. 8a shows a schematic side sectional view of a device 10 accordingto an embodiment in a first operating state. The device 10 can be amobile or immobile device, such as a mobile phone, a smartphone, amobile computer such as a tablet computer and/or a mobile music player.

The device 10 includes a multi-aperture imaging device 11, such as themulti-aperture imaging device 1000, 2000, 3000, 4000, 4000′, 5000 and/or6000 comprising an image sensor 12, an array 14 of juxtaposed opticalchannels 16 and beam-deflecting means 18. The beam-deflecting means 18is configured to deflect an optical path 17 of the optical channels 16and will be discussed in detail below. The device 10 includes a housing22 with external surfaces 23 enclosing a housing volume 24. This meansthe housing volume 24 can include an inner volume of the housing 22 andthe volume of the housing 22. Thus, the housing volume includes also avolume claimed by the housing walls and is hence enclosed by theexternal surfaces 23 of the housing. The housing 22 can be formed in atransparent or opaque manner and can include, for example, plasticmaterials and/or metal materials. The beam-deflecting means 18 has afirst position inside the housing volume 24. Holes or openings in thesides of the housing, such as for acoustical channels of microphones orfor electrical contacts of the device 10, can be neglected fordetermining the housing volume 24. The housing 22 and/or membersarranged within the housing 22 can block the optical path 17 of theoptical channels 16 after deflection by the beam-deflecting means 18,such that a field of view 26 arranged outside the housing 22 that is tobe captured by the multi-aperture imaging device 11 cannot be capturedat all or only to a limited extent. The members can, for example, be anaccumulator, printed circuit boards, non-transparent areas of thehousing 22 or the same. In other words, instead of a conventional cameraobjective, a different, possibly non-optical, device can be arranged ona housing.

The housing 22 can comprise an opening 28 through which the housingvolume 24 is connected to an external volume 25 of the housing 22. Attimes, the opening 28 can be completely or partly closed by a cover 32.The first operating state of the device 10 can be an inactive operatingstate of the multi-aperture imaging device 11 where the optical channels16 are directed, for example, on the inner side of the housing 22 or arenot deflected at all.

In other words, the installation height of the structure of themulti-aperture imaging device is at least partly determined by thediameter of optics of the optical channels 16 (lenses). In a (possiblyoptimum) case, the extension of the mirrors (beam-deflecting means) inthis thickness direction is equal to the extension of the lenses in thisdirection. Here, however, the optical path of the optical channel 16 isrestricted by the mirror 18. This results in a reduction of imagebrightness, wherein this reduction depends on the field angle. Thepresent embodiments solve this problem by moving parts of or the totalmulti-channel camera structure, such that, in the operating state of thecamera, parts of the structure project beyond the housing, e.g., of asmartphone compared to the non-usage state of the camera. The movementof the parts, such as the beam-deflecting means, can be rotational(folding out or folding open), translational (extending) or a mixedform. The additional movements of parts and the total system,respectively, allow a minimum structural shape in the non-usage mode ofthe camera, similar to known objectives of compact cameras, and agreater structural shape in the usage mode of the camera optimized forrealizing the technical function.

FIG. 8b shows a schematic side sectional view of the device 10 in asecond operating state. In the second operating state, thebeam-deflecting means 18 has a second position outside the housingvolume 24. This enables the beam-deflecting means 18 to deflect theoptical paths 17 of the optical channels 16 outside the housing volume24 and the field of view 26 so that the same can be captured outside thehousing 22 by the multi-aperture imaging device 11. The cover 32 can bemoved away from the position shown in FIG. 1a , such that thebeam-deflecting means 18 can be moved out of the housing volume 24through the opening 28 of the housing 22. The beam-deflecting means 18can be moved translationally and/or rotationally between the firstposition and the second position. It is advantageous that the membersinside the housing 22 and/or the housing 22 itself do not block thedeflected optical path 17 of the optical channels 16.

The multi-aperture imaging device 11 can be arranged in a camera housingwhich is arranged again at least partly inside the housing 22. Thecamera housing can be formed, for example, at least partly by a travelcarriage as described in the context of FIG. 12. This differs from aconcept where a single-channel camera is oriented in differentdirections by means of a folding mechanism in that in the present caserotation or tilting of the image sensor and/or the imaging optics can beprevented.

A total field of view can be captured by means of the device 10 suchthat, starting from the first position, the beam-deflecting means ismoved into the second position, where the beam-deflecting means isplaced at least partly outside of a housing volume. When thebeam-deflecting means is in the second position, the total field of viewcan be captured by the array of juxtaposed optical channels of themulti-aperture imaging device whose optical paths are deflected by thebeam-deflecting means.

FIG. 9a shows a schematic side sectional view of a device 20 accordingto a further embodiment in a first operating state. The device 20comprises the cover 23 which is pivoted on the housing 22, for examplevia a connecting element 34 a and/or via an optional connecting element34 b. The connecting element 34 a and/or 34 b can be configured to allowtilting and hence rotational movement between the cover 23 of thebeam-deflecting means 18 with respect to the housing 22 and can beformed, for example, as hinge or roller bearing.

The beam-deflecting means 18 can form a cover of the housing or can bepart thereof. One of the beam-deflecting surfaces of the beam-deflectingmeans 18 can be an outer edge of the housing. The beam-deflecting means18 comprising a first position and closes the housing 22 partly orcompletely. The beam-deflecting means 18 can comprise, for example, areflective area for deflecting the optical path 17 and can comprisecontact areas that are configured to form a mechanical contact with thehousing 22 in the first position. Simply put, the camera might not oronly hardly be visible when not in use.

FIG. 9b shows a schematic side sectional view of the device 20 in asecond operating state. In the second operating state, thebeam-deflecting means 18 can be moved rotationally with respect to thehousing 22, i.e., folded out, such that the housing volume 24 is opened.The rotational tilting allows an inclined or tilted orientation of thebeam-deflecting means 18 with respect to a course of the optical path 17of the optical channel 16 between the image sensor 12 and thebeam-deflecting means 18, such that the optical path 17 is deflected ina first direction 19 a at the beam-deflecting means 18.

FIG. 9c shows a schematic side sectional view of the device 20 in athird position. The device 20 can be in the second operating state.Compared to the second position as illustrated in FIG. 9b , thebeam-deflecting means 18 can deflect the optical path 17 of the opticalchannels 16 in a different direction 19 b, such that a different fieldof view or a field of view positioned at a different location can becaptured. For example, this can be a first side and an opposite sidesuch as front side and rear side, left and right or top and bottom ofthe device 20 and/or a user into which the optical path 17 is deflected.The connecting elements 34 a and 34 b can be connected, for example,with a frame structure and the beam-deflecting means 18, such that thebeam-deflecting means 18 can alternatively comprise the second or thirdposition. By a switchable viewing direction of the multi-apertureimaging device, conventional solutions in particular in smartphonesusing two cameras with viewing direction to the front and back can bereplaced by one structure.

FIG. 10a shows a schematic side sectional view of a device 30 accordingto a further embodiment in the first operating state. Compared to theapparatus 20 as described in FIGS. 3a-3b , the device 30 comprises an atleast partly transparent cover 36 arranged between an outer edge 23 ofthe housing 22 and the multi-aperture imaging device 11. The at leastpartly transparent cover is connected to the beam-deflecting means 18and configured to move based on a movement of the beam-deflecting means18. The at least partly transparent cover 36 can, for example, comprisepolymer and/or glass materials.

In other words, devices can be provided which allow encapsulation of theoptics for protection from decontamination with the option of changingthe encapsulated volume (moveable cover glasses).

FIG. 10b shows a schematic side sectional view of the device 30 in thesecond operating state. Compared to the device 20 in FIG. 9b , the atleast partly transparent cover is moved at least partly out of thehousing volume 24. This can be performed by a rotational movement of thebeam-deflecting means around the connecting element 34. Thebeam-deflecting means 18 is configured to deflect the optical path 17 ofthe optical channels 16 such that the optical channels run through theat least partly transparent cover. The cover 36 is configured to reduceor prevent entry of particles, dirt and/or moisture into the housingvolume 24. Here, the cover 36 can be formed in a transparent and/orpartly opaque manner for the optical paths 17. The cover 36 can, forexample, be opaque for specific wavelength ranges of electromagneticradiation. It is an advantage of the cover 36 that due to the reducedamount of particles, dirt and/or moisture, long operating life of thedevice and/or a continuously high image quality can be obtained sincecontamination of optics of the optical channels is low.

FIG. 10c shows a schematic side sectional view of the device 30 wherethe beam-deflecting means 18 is translationally movable with an optionalactuator 38 along a direction y perpendicular to a direction x of theoptical path 17 between the image sensor 12 and the optical channels 16and perpendicular to a direction z perpendicular to a line-extensiondirection of the array of optical channels 16. The beam-deflecting means18 can also be moved translationally around the connecting element 34based on the rotational movement, for example around a guide, a level orthe same. The folding up (rotational movement) can be performed manuallyor by using an actuator. The optional actuator 38 can be arranged on thebeam-deflecting means 18. Alternatively, the actuator 38 can be arrangedbetween the housing 22 and the beam-deflecting means 18. The actuator 38can be arranged, for example, between the housing 22 and the connectingelement 34 a and/or between the connecting element 34 a and thebeam-deflecting means 18. It is an advantage that due to thetranslational movement of the beam-deflecting means along the xdirection of the housing, shading of the field of view to be captured bythe housing 22 can be reduced.

FIG. 11a shows a schematic side sectional view of a device 40 accordingto an embodiment in the first operating state, in the first position thebeam-deflecting means 18 is arranged inside the housing volume of thehousing 22 and is configured to be moved, based on a translationalmovement 42, from the first position to the second position which isschematically illustrated in FIG. 11b . As illustrated in FIG. 11a , thehousing can comprise the cover 32 which closes the housing 22 and anopening therein, respectively, in the first operating state. Thebeam-deflecting means 18 can be oriented in the first operating statesuch that the same has a minimum extension perpendicular to a directionx which is defined by the optical path inside the housing 22.

FIG. 11b shows a schematic side sectional view of the device 40 in thesecond operating state. The beam-deflecting means is moved out of thehousing volume 24 based on the translational movement 42, for example,along the x direction. For this, the beam-deflecting means 18 can bemoved through the opening 28. The beam-deflecting means 18 can berotationally moveable around an axis of rotation 44. During thetranslational movement between the first operating state and the secondoperating state, the beam-deflecting means 18 can perform a rotationalmovement around the axis of rotation 44. An angular orientation of thebeam-deflecting means can be amended compared to the first operatingstate of FIG. 11a , such that the area of the beam-deflecting means usedby the optical path of the multi-aperture imaging device increases incomparison to the first operating state. A rotational movement 46 aroundthe axis of rotation 44 allows a variable inclination of thebeam-deflecting means 18 with respect to the optical path 17 between theoptical channels 16 and the beam-deflecting means 18 and hence avariable direction in which the optical path 17 of the optical channel16 is deflected. The optical channels 16 can comprise optics 64 a-b.

In addition to the beam-deflecting means 18, optics 64 a-b of theoptical channels 16 and/or the image sensor 12 can be arranged outsidethe housing volume 24 in the second operating state. The optics 64 a-bof the optical channels 16 and/or the image sensor 12, for example, canbe moved together with the beam-deflecting means 18. This allows a shortto minimum distance between the optics 64 a-b of the optical channelsand the beam-deflecting means 18, in particular in the second operatingstate. The short distance enables a small surface area of thebeam-deflecting means 18. An increasing distance would entail a greaterarea of the beam-deflecting means 18 for completely deflecting thescattering optical path of the optical channels 16. Due to the short orminimum distance, the beam-deflecting means 18 can also have a smallarea, which is advantageous, since a smaller member has to be moved andby a rotational movement, a thickness of the device does have to beincreased only slightly or not at all with respect to a state where thebeam-deflecting means 18 is not arranged. The small size has also anadvantageous effect on installation space requirements, for example inthe first operating state.

In other words, multi-aperture cameras with linear channel arrangementcomprise several optical channels that are juxtaposed and each transmitparts of the total field of view. Advantageously, a mirror is mounted infront of the imaging lenses which can be used for beam deflection andcontributes to reducing the installation height. In combination with amirror that is adapted channel by channel, such as a facet mirror,wherein the facets are planar or curved in an arbitrary manner orprovided with a freeform area, it is advantageously possible that theimaging optics of the optical channels are essentially structuredidentically, whereas the viewing direction of the channels ispredetermined by the individual facets of the mirror array. A surface ofthe beam-deflecting means is at least mirrored at the reflecting facetsallocated to the optical channels. It is also possible that the imagingoptics of the channels are implemented differently, such that differentviewing directions result by the angle of the mirror facet and theimplementation of the respective optical channel. It is further possiblethat several channels use the same area of the beam-deflecting means andhence the number of facets is smaller than the number of channels. Here,the deflecting mirror can be pivoted, wherein the axis of rotation runs,for example, parallel to the extension direction of the channels. Thedeflecting mirror can be reflective on both sides, wherein metallic ordielectric layers (sequences) can be used. The rotation of the mirrorcan be analog or stable along one/several directions. Based on therotational movement, the beam-deflecting means can be movable between atleast a first position and a second position, wherein the optical pathsare deflected in differing directions in each position. In a similar wayas described for the positions of the beam-deflecting means 18 in FIGS.9a-9c , the beam-deflecting means can also be moved around an axis ofrotation. In addition to the translational movement of the housing cover32 and the beam-deflecting means 18, parts and all additional componentsof the multi-aperture imaging device, respectively, can be co-moved in atranslational manner in the same direction, wherein the same or alsodifferent travel ranges are possible.

FIG. 12a shows a schematic side sectional view of the device 50 wherethe cover 32 is arranged rotationally moveable via a moving element 34on a housing side 22 b of the housing 22. The beam-deflecting means 18can be mechanically connected to a travel carriage 47. The travelcarriage 47 can be considered as mechanical transport means for movingat least the beam-deflecting means 18. The device 50 can include anactuator 33 that is configured to translationally move the travelcarriage 47. The actuator can include any drive, such as step motor,piezoelectric drive or a voice coil drive. As an alternative or inaddition to the actuator 33, the device 50 can include an actuator 33′that is configured to release a mechanical lock 35 which locks the cover32 and the housing on, at least, one housing side 22 a. Thebeam-deflecting means or travel carriage 47 can be driven out of thehousing by means of a spring force when the lock 33′ is released. Thismeans the lock 35 can be configured to maintain the beam-deflectingmeans 18 in the first position. The travel carriage 47 can also bearranged in the device 40. This means the travel carriage 47 can also beused for translational movement of the cover 32.

FIG. 12b shows a schematic side sectional view of the device 50 wherethe travel carriage 47 is moved along the translational direction ofmovement 42, such that the beam-deflecting means 18 is moved out of thehousing volume 24. The image sensor 12 and/or optics of the opticalchannels 16 can also be mechanically connected to the travel carriage 47and can be moved together with the beam-deflecting means 18 to the sameextent. Alternatively, the image sensor 12 and/or the optics of theoptical channels 16 can be moveable to a smaller extent than thebeam-deflecting means 18, such that a distance between the image sensor12, the optics and/or beam-deflecting means 18 increases duringextension. Alternatively or additionally, the image sensor 12 and/or theoptics of the optical channels can be located stationary with respect tothe housing, such that merely the beam-deflecting means 18 is moved bymeans of the travel carriage 47. An increasing distance between theimage sensor 12, the optics and/or beam-deflecting means 18 during anextension allows a lower distance of the components in the firstoperating state, such that the multi-aperture imaging device can beaccommodated in the housing 22 with less installation spacerequirements.

FIG. 12c shows a schematic side sectional view of the device 50 in thesecond operating state. The beam-deflecting means can be pivoted forperforming the rotational movement 46 as described, for example, for thedevice 40. As described in the context of FIG. 11b , the angularorientation of the beam-deflecting means 18 can be amended compared tothe first operating state of FIG. 12a or the state in FIG. 12b , suchthat the area of the beam-deflecting means used by the optical path ofthe multi-aperture imaging device increases compared to the firstoperating state. The side of the beam-deflecting means 18 facing theoptical channels 16 and the image sensor 12, respectively, can have adimension B perpendicular to the translational direction of movement 42,for example along the y direction that is greater than a dimension A ofthe image sensor 12 and the optical channels 16, respectively, alongthis direction. The dimension B is, for example, perpendicular to aline-extension direction of the array and parallel to a surface of animage sensor on which the optical channels impinge. This can have theeffect that a high amount of light can be deflected by thebeam-deflecting means 18 and a brightness of an image to be captured ishigh. In a position shown in FIG. 12a , the extension or dimension B issmaller than in the position shown in FIG. 12c or a position where thebeam-deflecting means 18 directs the optical path in another viewingdirection.

FIG. 13a shows a schematic side sectional view of a device 60 accordingto an embodiment in the first operating state. The beam-deflecting means18 is in the first position. Compared to the device 40 and the device asdescribed in FIGS. 4a and 4b , the device 50 comprises at least partlytransparent covers 36 a and 36 b that are connected to the cover 32 andcan be moved with the same along the translational direction of movement42. The at least partly transparent covers 36 a and 36 b can each bearranged on different sides of the beam-deflecting means 18 between thesame and the housing 22. In the first operating state, the covers 36 aand 36 b can be arranged partly or completely inside the housing volume24. The covers 36 a and 36 b can be arranged, for example, on the travelcarriage 47 illustrated in FIG. 12a-c or can be transparent areas of thetravel carriage 47.

FIG. 13b shows a schematic side sectional view of the device 60 wherethe beam-deflecting means 18 is in an intermediate position between thefirst position and the second position. The intermediate position of thebeam-deflecting means can be obtained, for example, during retraction orextension of the beam-deflecting means 18 into the housing volume 24 andout of the housing volume 24, respectively. The beam-deflecting means 18is partly moved out of the housing volume 24.

FIG. 13c shows a schematic side sectional view of the device 60 wherethe beam-deflecting means 18 is in the second position, i.e., thebeam-deflecting means 18 is, for example, completely extended out of thehousing volume 24. The at least partly transparent covers 26 a and 36 bhave a distance 48 to one another that is smaller than a comparativedistance between lateral faces of the housing 22 a and 22 b.

FIG. 13d shows a schematic side sectional view of the device 60 where adistance of the at least partly transparent covers 36 a and 36 b isenlarged compared to FIGS. 13a-13c . The at least partly transparentcovers 36 a and/or 36 b can be moveable along a translational directionof movement 52 a and 52 b, respectively, e.g. along a positive ornegative y direction facing away from the respective other at leastpartly transparent cover 36 a and 36 b, respectively. The state of theat least partly transparent covers 36 a and 36 b illustrated in FIG. 13a-c can be considered as retracted or folded-in state. The stateillustrated in FIG. 13d can be considered as extended or folded outstate, where a distance 48′ between the at least partly transparentcovers 36 a and 36 b is changed and enlarged, respectively, with respectto the distance 48. The distance 48′ can, for example, be greater thanor equal to the distance between the comparable sides of the housing 22.The beam-deflecting means 18 is configured to deflect the optical pathsof the optical channels such that the same run through the at leastpartly transparent covers 36 a and/or 36 b. As described in the contextof FIG. 11b , FIG. 12a and FIG. 12b , the angular orientation of thebeam-deflecting means 18 can be amended compared to the first operatingstate of FIG. 13a or the state in FIG. 13b or 13 c, such that the areaof the beam-deflecting means used by the optical path of themulti-aperture imaging device increases compared to the first operatingstate. Alternatively or additionally, the enlarged distance 48′ canallow an increased extent of the rotational movement 46. With therotational movement 46, the beam-deflecting means 18 can be switchablebetween at least a first and a further position, wherein each positioncan be allocated to a viewing direction of the multi-aperture imagingdevice. A rotation of the mirror can be analog or stable alongone/several directions. The rotational movement 46 for changing aviewing direction of the multi-aperture imaging device can be combinedwith a rotational movement of the beam-deflecting means 18 for opticalimage stabilization, which is described in the context of FIG. 19. Thecovers 36 a and/or 36 b can encapsulate the other components of themulti-aperture imaging device.

The oppositely arranged covers 36 a and/or 36 b and transparent areasthereof, respectively, can comprise a switchable diaphragm, such thatthe switchable diaphragm is introduced, for example, above and/or belowor along any direction of the beam-deflecting means. The diaphragm canbe switched depending on the operating state and viewing direction ofthe camera. For example, a viewing direction of the multi-apertureimaging device which is not used can be at least partly closed by thediaphragm for reducing entry of stray light. The diaphragms can be, forexample, mechanically moved or can be electrochromic. The areasinfluenced by the diaphragm can additionally be provided with aswitchable diaphragm which covers the optical structure for the case ofnon-usage. The diaphragm can be electrically controllable and caninclude an electrochromic layer (sequence). The diaphragm can include amechanically moved part. The movement can be performed by usingpneumatic, hydraulic, piezoelectric actuators, DC motors, step motors,thermal actuators, electrostatic actuators, electrostrictive and/ormagnetostrictive actuators or drives. In a state of the multi-apertureimaging device where the viewing direction penetrates a diaphragm, thediaphragm can be switched such as to let the optical paths of theoptical channels pass. This means that the multi-aperture imaging devicecan have a first operating state and a second operating state. Thebeam-deflecting means can deflect the optical path of the opticalchannels in the first operating state such that the same passes througha first transparent area of the cover 36 a. In the second operatingstate, the optical path of the optical channels can be deflected suchthat the same passes through a second transparent area of the cover 36b. A first diaphragm 53 a can be configured to optically close the firsttransparent area in the second operating state at least partly. A seconddiaphragm 53 b can be configured to optically close the secondtransparent area at least partly in the first operating state at times.In that way, entry of stray light from a direction which is not thecurrent viewing direction of the multi-aperture imaging device can bereduced, which has an advantageous effect on the image quality. Thefirst and/or second diaphragm 53 a-b can be effective for at least one,for at least two or for all of the optical channels. For example, atleast one, at least two or all optical channels of the multi-apertureimaging device can pass through the first diaphragm when the opticalpath of the optical channel is directed through the first transparentarea and can pass through the second diaphragm when the optical path ofthe optical channels is directed through the second transparent area.

It should be noted that it is possible to combine a mechanism forfolding out the beam-deflecting means according to FIGS. 2 and 3 with amechanism for translational movement, i.e., mixed forms can occur.Folding out the housing and/or extending the beam-deflecting means canbe performed such that possibly the imaging module, i.e., the opticalchannels, optics thereof and/or the image sensor are moved out of thehousing volume. An angular change of the beam-deflecting means canenable an extension of the multi-aperture imaging device in thicknessdirection to be large and/or that the beam-deflecting means canunimpededly deflect the optical path towards the “front” and “back”.Cover glasses, such as the covers 36 can also be fixed with respect tothe folded out or extended elements. The cover glasses can have anyplanar or non-planar surface.

FIG. 14 shows a schematic perspective view of a device 70 according toan embodiment having the three multi-aperture imaging devices 11 a-c.The multi-aperture imaging devices 11 a-c can be translationally movablealong a respective translational movement direction 42 a-c. Themulti-aperture imaging devices 11 a-c can be arranged in secondary sides22 c-f of the housing 22. The housing can be formed in a flat manner,this means a first extension of the housing 22 along a first housingdirection, for example an x direction, and a second extension of thehousing 22 along a second housing direction, for example a z directioncan have at least a three-fold dimension, at least a five-fold or atleast a seven-fold dimension compared to a third extension of thehousing 22 along a third housing direction, such as a y direction. Amain side 22 a and/or 22 b of the housing 22 can have the first andsecond dimension and can be arranged, for example, in parallel to an x/zplane in space. The secondary sides 22 c-f can connect the main sides 22a and 22 b and can be arranged between the same, respectively.

The multi-aperture imaging devices 11 a and 11 b can be arranged in oron the same side 22 d in the housing 22 and can have, for example, abase distance BA to one another, such as for the purpose of stereoscopy.More than two modules would also be possible. In this way, the totalfield of view can be captured, for example, stereoscopically or higherby usage of the multi-aperture imaging device 11 c and at least onefurther multi-aperture imaging device 11 a and/or 11 b. Themulti-aperture imaging devices 11 a, 11 b and/or 11 c can beindividually moveable. Alternatively, two or more of the modules canalso be movable together as total system.

As will be described in detail below, the device 70 can be configured tocapture a total field of view at least stereoscopically. The total fieldof view is arranged, for example, on one of the main sides 22 a or 22 b,but can also be arranged on a secondary side 22 c-f. For example, themulti-aperture imaging devices 11 a-c can each capture the total fieldof view. While the multi-aperture imaging devices 11 a-c are illustratedin a manner spatially spaced apart from one another, the multi-apertureimaging devices 11 a, 11 b and/or 11 c can also be arranged spatiallyadjacent or combined. The arrays of the imaging devices 11 a and 11 b,possibly arranged in a single line, can, for example, be arranged besideone another or parallel to one another as described, for example, in thecontext of FIG. 20b . The arrays can form lines with respect to oneanother, wherein each multi-aperture imaging device 11 a and 11 bcomprises a single-line array. The imaging devices 11 a and 11 b cancomprise a common beam-deflecting means and/or a common carrier ofoptics of the optical channels and/or a common image sensor.

FIG. 15 shows an enlarged perspective view of a section of the device 70and the multi-aperture imaging devices 11 a and 11 b. The device 70 isin the second operating state. The multi-aperture imaging device 11 aand/or 11 b projects, for example, beyond the original housing side. Thebeam-deflecting means 18 a and 18 b are moved at least partly and basedon the translational directions of movement 42 a and 42 b outside thehousing volume. Alternatively, in the second operating state, merelypart of the beam-deflecting means of the multi-aperture imaging devices11 a-c can be moved out of the housing volume of the housing 22.

The multi-aperture imaging devices 11 a-b comprise, for example, fouroptical channels 16 a-d and 16 e-h each. The beam-deflecting means 18 aand 18 b are each configured to deflect the optical paths 17 a-d and 17e-h, respectively, of the optical channels 16 a-d and 16 e-h,respectively. As will be described in detail below, other multi-apertureimaging devices can have a differing number of optical channels. Themulti-aperture imaging devices 11 a-b can have the same or a differingnumber of optical channels.

The multi-aperture imaging devices 11 a and 11 b each compriseillumination means 54 a and 54 b and 54 c and 54 d, respectively. Theillumination means 54 a-d are configured to illuminate the total fieldof view to be captured at least partly and, for example, can each beconfigured to illuminate a center of the total field of view (objectarea) to be captured. According to an embodiment, at least one of theillumination means 54 a or 54 b and 54 c or 54 d, respectively, can bearranged such that the same illuminates the total field of view along acentral viewing direction of the optical channels 16 a-d and 16 e-h,respectively. The total field of view can comprise differing partialfields of view that are each captured by at least one optical channel 16a-d and 16 e-h, respectively. A central viewing direction of opticalchannels 16 a-d or 16 e-h can, for example, be a geometrical average ofthe viewing directions or a median value of the viewing directions.

The illumination means 54 a-b and 54 c-d can be operated as a flashlight of the respective multi-aperture imaging device 11 a or 11 b andcan include any light source. Advantageously, the light source can beconfigured, for example, as a light emitting diode (LED) since the samehave low insulation space requirements and low energy requirements.According to further embodiments, a multi-aperture imaging device caninclude no, one or more than two illumination means 54 a-d, wherein thenumber of illumination means 54 a-d of a multi-aperture imaging devicecan differ from other multi-aperture imaging devices of a device or canbe the same. At least one of the illumination means 54 a-d can beconfigured to illuminate several object areas. In that way, light can,for example, be selectively emitted by the illumination means in one orseveral directions. The illumination means can emit light along at leasttwo viewing directions of the multi-aperture imaging device. For this,the illumination means can comprise at least two light sources. Thelight sources can emit light in opposite sides of the device. Forexample, one light source each can be mounted on a top and bottom, frontand rear and/or left and right side of the travel carriage 47, whereonly the light source(s) of that side are used that opposes the objectarea to be captured according to the selected orientation and hence theoperating state of the beam-deflecting means 18 and emits light in itsdirection. The above mentioned front, rear top and bottom as well as theterms left or right merely serve for illustration purposes and are notto be understood in a limiting sense, since the same are mutuallyexchangeable with each orientation in space. This means, for example,that light sources 54 i can be arranged on the front and rear of thetravel carriage 47 b and depending on the position of thebeam-deflecting means 18 b respective light sources can be used. Theother opposite light sources can remain unused.

For example, the illumination means 54 a and 54 b are arranged betweenthe beam-deflecting means 18 a and the image sensor 12 a of themulti-aperture imaging device 11 a. The beam-deflecting means 18 can beconfigured to deflect illumination radiation, for example flashlight,emitted by the illumination means 54 a and/54 b. The illumination means54 a-b can be arranged in the first operating state and in the secondoperating state of the device 70 inside the housing volume. Theillumination radiation can be at least partly part of the optical paths17 a-d. As illustrated, for example, for the multi-aperture imagingdevice 11 b, an illumination means 54 c and/or 54 d can be arrangedlaterally beside the beam-deflecting means on the travel carriage 47 b.The illumination means 54 c and 54 d can be moved with the translationalmovement 42 b into the housing 22 or out of the housing 22. While theillumination means is described in the context of the device 70, alsoother devices or multi-aperture imaging devices described herein cancomprise an illumination means.

The illumination means 54 c and 54 d can be mechanically connected tothe travel carriage 47 a and can thus be arranged within the volume 42in the first operating state and hence be arranged in a manner invisiblefor a user. Alternatively and/or additionally, the illumination means 54a and 54 b can be arranged in a stationary manner inside the housing 22.A movement of the travel carriage 47 b can effect a movement of theillumination means 54 c and 54 d.

Together with the beam-deflecting means 18 a and 18 b, respectively,optics 16 a-d or 16 e-f and possibly the image sensor 12 a and 12 b,respectively, can be moved out of the housing volume by the movement ofthe travel carriage 47 a and 47 b, respectively.

In other words, LEDs for realizing additional illumination (flash light)can be mounted on the moveable parts. Here, the LEDs can be arrangedsuch that the same radiate in the central direction of the channels andthe beam-deflecting means can provide further areas that are used fordeflecting the radiation, respectively.

FIG. 16 shows a schematic perspective view of device 90 according to anembodiment comprising the second operating state. The beam-deflectingmeans 18 can be connected to the multi-aperture imaging device by meansof mounting elements 56 a and 56 b. The mounting element 56 a and 56 bcan be part of a travel carriage.

FIG. 17a shows a schematic perspective view of device 100 according toan embodiment in the first operating state. The cover 32 can form oneplane with a housing main side and/or a housing secondary side, forexample the housing plane side 22 c. No gap or merely a small gapapproximately less than or equal to 1 mm, less than or equal to 0.5 mmor less than or equal to 0.1 mm can be arranged between the cover 32 andthe housing side 22 c, such that a transition between the cover 32 andthe housing side 22 c is not or only hardly noticeable. Simply put, thecover 32 might not be visible.

FIG. 17b shows a schematic view of the device 100 in the secondoperating state. The beam-deflecting means 18 comprises the secondposition outside the housing volume. Seen from outside, the extendedmulti-aperture imaging device can be enclosed by the inactive housingframe on all sides and/or can have an appearance like a button. Thedevice 100 can, for example, be configured to release a mechanical lockduring mechanical pressure on the cover 32 according to FIG. 17a , suchthat the beam-deflecting means can be moved out of the housing 22, forexample based on a spring force. The mechanical pressure can begenerated, for example, by an actuator and/or by a user, such as byfinger pressure. The beam-deflecting means can be moved from the secondposition again to the first position by means of the actuator or bymeans of the mechanical pressure and can activate a lock there. Theactuator can, for example, be the actuator 33 or 33′. In other words,the movement can also be performed manually, such that the user retractsor extends and folds in or out, respectively, the parts or the totalsystem on his own accord. The movement can, in particular, be acombination of manual operation and effect of spring force. In that way,the user folds or shifts parts and the total system, respectively,manually into the housing of the device, such as a smartphone, forswitching off the camera, thereby compressing a spring and a lockingmechanism maintains this position. When switching on the camera, forexample by means of suitable software on the smartphone, the switchablelocking mechanism is released by a suitable controllable mechanism, suchas an electrical relay, and the spring force of the spring effects theextension and folding out, respectively, of parts of the camera and thetotal system, respectively. Further, the cover forming part of thehousing, the extendable and/or tiltable part and/or a further mechanismbased thereon can be implemented such that (finger) pressure on thiscover releases the lock, the parts or the total system expand or foldout, respectively, and possibly the image capturing software on thedevice starts. The co-moving cover, which can form part of the housingon the lateral faces, can be enclosed on all sides by the inactivehousing, visible from the outside, or can interrupt the lateral facesacross the total height (=thickness direction of the housing).

FIG. 17c shows a schematic illustration of an alternative to FIG. 17awhere the cover 32 is formed such that a continuous gap is formed in thesecondary side 22 c between main sides of the housing 22. This enablesthat merely two instead of four gaps illustrated in FIG. 17a can beperceived in the housing 22. The extendable or foldable cover 32 and/orfurther covers can be formed as part(s) of the housing 22 on one orseveral lateral faces of the flat housing.

In the following, reference is made to some possible embodiments of themulti-aperture imaging device as it can be used according toembodiments.

FIGS. 18a-18c show a multi-aperture imaging device 11 according to anembodiment of the present invention. The multi-aperture imaging device11 of FIGS. 18a-18c includes a single-line array 14 of juxtaposedoptical channels 16 a-d. Each optical channel 16 a-d includes optics 64a-d for projecting a respective partial field of view 74 a-d of a totalfield of view 72 of the device 11 on a respectively allocated imagesensor area 58 a-d of an image sensor 12. The image sensor areas 58 a-dcan, for example, each be formed of one chip including a respectivepixel array, wherein the chips can be mounted on a common substrate anda common printed circuit board 62, respectively, as indicated in FIGS.18a-18c . Alternatively, it would also be possible that the image sensorareas 58 a-d are each formed of part of a common pixel arraycontinuously extending across the image sensor areas 58 a-d, wherein thecommon pixel array is formed, for example, on a single chip. Forexample, merely the pixel values of the common pixel array are read outin the image sensor areas 58 a-d. Different mixtures of thesealternatives are also possible, such as the presence of one chip for twoor more channels and a further chip for again other channels or thesame. In the case of several chips of the image sensor 12, the same canbe mounted, for example, on one or several printed circuit boards, suchas e.g., all together or in groups or the same.

In the embodiment of FIGS. 18a-18c , four optical channels 16 a-d arearranged in a single line beside one another in line-extension directionof the array 14, but the number four is merely exemplary and could alsobe any other number greater than one. Above that, the array 14 can alsocomprise further lines extending along the line-extension direction.

Optical axes and optical paths 17 a-d, respectively, of the opticalchannels 16 a-d run parallel to one another between the image sensorareas 58 a-d and the optics 64 a-d. For this, the image sensor areas 58a-d are arranged, for example, in a common plane and also the opticalcenters of optics 64 a-d. Both planes are parallel to one another, i.e.,parallel to the common plane of the image sensor areas 58 a-d.Additionally, in a projection perpendicular onto the plane of the imagesensor areas 58 a-d, optical centers of the optics 64 a-d coincide withcenters of the image sensor areas 58 a-d. In other words, in theseparallel planes, optics 64 a-d on the one hand and image sensor areas 58a-d are arranged with the same repeat distance in line-extensiondirection.

An image-side distance between image sensor areas 58 a-d and theallocated optics 64 a-d is adjusted such that the projections on theimage sensor areas 58 a-d are set to a desired object distance. Thedistance is, for example, in a range equal to or greater than the focallength of optics 64 a-d or, for example, in a range between one time andtwo times the focal length of the optics 64 a-d, both inclusive. Theimage-side distance along the optical axes 17 a-d between image sensorarea 58 a-d and optics 64 a-d can also be adjusted, such as manually bya user or automatically via autofocus control.

Without additional measures, the partial fields of view 74 a-d of theoptical channels 16 a-d overlap essentially completely due to theparallelism of the optical paths and optical axes 17-d, respectively.For covering a greater total field of view 72 and so that the partialfields of view 74 a-d merely overlap partly in space, thebeam-deflecting means 18 is provided. The beam-deflecting means 18deflects the optical paths 17 a-d and optical axes, respectively, with achannel-individual deviation into a total field of view direction 76.The total field of view direction 76 runs, for example, parallel to aplane that is perpendicular to the line-extension direction of the array14 and parallel to the course of the optical axes 17 a-d prior to andwithout beam deflection, respectively. For example, the total field ofview direction 76 results from the optical axes 17 a-f by rotationaround the line-extension direction by an angle that is >0° and <180°and is, for example, between 80 and 100° and can, for example, be 90°.Thus, the total field of view of the device 11 corresponding to thetotal coverage of the partial fields of view 74 a-d is not in thedirection of an extension of the series connection of the image sensor12 and the array 14 in the direction of the optical axes 17 a-d, but dueto the beam deflection, the total field of view is on the side of theimage sensor 12 and array 14 in a direction in which the installationheight of the device 11 is measured, i.e., the lateral directionperpendicular to the line-extension direction. Additionally, thebeam-deflecting means 18 deflects each optical path and the optical pathof each optical channel 16 a-d, respectively, with a channel-individualdeviation from the deflection resulting in the direction 76 mentionedabove. For this, the beam-deflecting means 18 comprises a reflectingfacet 68 a-d for each channel 16 a-d. The same are slightly inclinedwith respect to one another. The mutual tilting of the facets 68 a-d isselected such that, during beam deflection by the beam-deflecting means18, the partial fields of view 74 a-d are provided with a slightdivergence such that the partial fields of view 74 a-d overlap merelypartly. Here, as indicated exemplarily in FIG. 18a , the individualdeflection can also be designed such that the partial fields of view 74a-d cover the total field of view 72 in a two-dimensional manner, i.e.,are arranged in a two-dimensionally distributed manner in the totalfield of view 72.

It should be noted that many of the details described so far concerningthe device 11 have merely been selected exemplarily. This alreadyconcerned, for example, the above-mentioned number of optical channels.The beam-deflecting means 18 can also be formed differently thandescribed above. For example, the beam-deflecting means 18 is notnecessarily reflective. The same can also be implemented differentlythan in the form of a facet mirror, such as in the form of transparentprism wedges. In that case, for example, the average beam deflectioncould be 0°, i.e., the direction 76 could, for example, be parallel tothe optical paths 17 a-d prior to or without beam deflection or, inother words, the device 11 could still “look straight ahead” despitebeam-deflecting means 18. The channel-individual deflection by thebeam-deflecting means 18 would again have the effect that the partialfields of view 74 a-d merely slightly overlap, such as in pairs with anoverlap <10% with regard to the spatial angular ranges of the partialfields of view 74 a-d.

Also, the optical paths and optical axes, respectively, could deviatefrom the described parallelism and the parallelism of the optical pathsof the optical channels could still so distinct that the partial fieldsof view that are covered by the individual channels 16 a-N and projectedon the respective image sensor areas 58 a-d, respectively, would mostlyoverlap without further measures, namely beam deflection, such that inorder to cover a greater total field of view by the multi-apertureimaging device 11, the beam-deflecting means 18 would provide theoptical paths with an additional divergence such that the partial fieldsof view of N optical channels 16 a-N overlap less. The beam-deflectingmeans 18 has, for example, the effect that the total field of view hasan aperture angle that is greater than 1.5 times the aperture angle ofthe individual partials fields of view of the optical channels 16 a-N.With some sort of pre-divergence of the optical paths 17 a-d, it wouldalso be possible that, for example, not all facet inclinations differbut that some groups of channels have, for example, the facets with thesame inclination. The latter could then be formed integrally andcontinuously merging, respectively, as virtually one facet that isallocated to this group of channels adjacent in line-extensiondirection. The divergence of the optical axes of these channels couldthen originate from the divergence of these optical axes, as it isobtained by lateral offset between optical centers of the optics andimage sensors areas of the channels or prism structures or decenteredlens sections. The pre-divergence could be limited, for example, to oneplane. Prior to or without beam deflection, respectively, the opticalaxes could run, for example, in a common plane but divergent within thesame, and the facets effect merely an additional divergence in the othertransversal plane, i.e., the same are all parallel to the line-extensiondirection and inclined with respect to one another only varying from theabove-mentioned common plane of the optical axes, wherein here againseveral facets can have the same inclination or can be allocatedtogether to a group of channels, whose optical axes differ, for example,already in the above mentioned common plane of the optical axes in pairsprior to and without beam deflection, respectively.

When omitting the beam-deflecting means or implementing thebeam-deflecting means as planar mirror or the same, the total divergencecould be accomplished by the lateral offset between optical centers ofthe optics on the one hand and centers of the image sensor areas on theother hand or by prism structures or decentered lens sections.

The above-mentioned possibly existing pre-divergence can, for example,be obtained in that the optical centers of the optics are on a straightline along the line-extension direction, while the centers of the imagesensor areas are arranged deviating from the projection of the opticalcenters along the normal of the plane of the image sensor areas onpoints on a straight line in the image sensor plane, such as on pointsdeviating from the points on the above mentioned straight line in theimage sensor plane in a channel-individual manner along theline-extension direction and/or along the direction perpendicular toboth the line-extension direction and the image sensor normal.Alternatively, pre-divergence can be obtained in that the centers of theimage sensors are on a straight line along the line-extension direction,while the centers of the optics are arranged deviating from theprojection of the optical centers of the image sensors along the normalof the plane of the optical centers of the optics on points on astraight line in the optics center plane, such as on points deviatingfrom the points on the above-mentioned straight line in the opticscenter plane in a channel-individual manner along the line-extensiondirection and/or along the direction perpendicular to both theline-extension direction and the normal of the optics center plane. Itis of advantage when the above mentioned channel individual deviationfrom the respective projection merely runs in line-extension direction,i.e., merely the optical axes in a common plane are provided with apre-divergence. Both optical centers and image sensor area centers arethen on a straight line parallel to the line-extension direction butwith different gaps in-between. A lateral offset between lenses andimage sensors in perpendicular lateral direction to the line-extensiondirection would, in comparison, result in an enlargement of theinstallation height. A pure in-plane offset in line-extension directiondoes not change the installation height but possibly less facets resultand/or the facets have only a tilting in one angular orientation whichsimplifies the structure.

This is illustrated in FIGS. 18d and 18e exemplarily for the case of theoptics held on a common carrier, where the adjacent channels 16 a and 16b on the one hand and the adjacent channels 16 c and 16 d on the otherhand comprise optical axes 17 a and 17 b and 17 c and 17 d,respectively, running in the common plane and squinting with respect toone another, i.e. provided with the pre-divergence. The facets 68 a and68 b can be formed by one facet and the facets 68 c and 68 d can beformed by another facet as shown by dotted lines between the respectivepairs of facets, and the only two facets are merely inclined in onedirection and both parallel to the line-extension direction. It is alsopossible that individual facets merely comprise one tilting in a spatialdirection.

Further, it could be provided that some optical channels are allocatedto the same partial field of view, such as for the purpose ofsuperresolution for increasing the resolution by which the respectivepartial field of view is scanned by these channels. The optical channelswithin such a group would then run parallel, for example, prior to beamdeflection and would be deflected on a partial field of view by onefacet. Advantageously, pixel images of the image sensor of a channel ofa group would lie in intermediate positions between images of the pixelsof the image sensor of a different channel of this group.

Even without super-resolution purposes, but merely for stereoscopicpurposes, an implementation would be possible where a group ofimmediately adjacent channels completely cover the total field of viewin line-extension direction with their partial fields of view, and thata further group of immediately adjacent channels also completely coverthe total field of view and the optical paths of both channel groupspass through the substrate and a carrier 66, respectively. This meansthat the multi-aperture imaging device can comprise a first plurality ofoptical channels that are configured to capture a total field of view,possibly completely. A second plurality of optical channels of themulti-aperture imaging device can be configured to also capture thetotal field of view possibly completely. In this way, the total field ofview can be captured at least stereoscopically by the first plurality ofoptical channels and by the second plurality of optical channels. Thefirst plurality of optical channels and the second plurality of opticalchannels can impinge on a common image sensor, can use a common array(array optics) and/or can be deflected by a common beam-deflectingmeans. In contrary to an array of individual cameras, a contiguous arraycamera is formed which can be controlled together as one device, forexample with regard to focus and/or image stabilization, which isadvantageous since all channels are influenced simultaneously and byusing the same actuators. Additionally, from the monolithic structure,advantages result with regard to the mechanical stability of the totalarray in particular during temperature changes. This is advantageous forthe assembly of the total image from the partial images of theindividual channels as well as for obtaining three-dimensional objectdata during the usage in stereo, triple, quadruple, etc., systems withmultiple scanning of the total field of view by different pluralities ofchannels 16.

The following discussion deals with the optics 64 a-d whose lens planesare also parallel to the common plane of the image sensor areas 58 a-f.As described below, lenses of the optics 64 a-d of the optical channels16 a-d are mounted on a main side 66 a of the substrate 66 via one orseveral lens holders and are mechanically connected to one another viathe substrate 66. In particular, the optical paths 17 a-d of theplurality of optical channels 16 a-d run through the substrate 66. Thus,the substrate 66 is formed at least partly of transparent material andis plate-shaped or has, for example, the shape of a parallelepiped oranother convex body having a planar main side 66 a and an opposite mainside 66 b that is also planar. The main sides may be positionedperpendicular to the optical paths 17 a-d. As described below, accordingto embodiments, deviations from the pure parallelepiped shape can occur,which are based on an integral formation of lenses of the optics withthe substrate.

The flat carrier substrate 66 in the embodiment of FIG. 11a-c is, forexample, a substrate of glass or polymer. For example, the carriersubstrate 66 can include a glass plate. The material of the substrate 66can be selected according to aspects of high optical transparence andlow temperature coefficient or further mechanical characteristics suchas hardness, elasticity or torsion module.

The substrate 66 can be formed as simple planar part of the optical pathwithout any additional lenses being mounted directly on the same.Additionally, diaphragms, such as aperture or stray light diaphragmsor/and filter layers such as IR block filters, can be mounted on thesubstrate surfaces or can consist of several layers of differentsubstrates on the surfaces of which diaphragms and filter layers can bemounted, which can differ again from channel to channel, for example asregards to their spectral absorption.

The substrate 66 can consist of a material having differentcharacteristics in different areas of the electromagnetic spectrum thatcan be captured by the image sensor, in particular non-constantabsorption.

In the embodiment of FIG. 18a-c , each optics 64 a-d comprises threelenses. However, the number of lenses is freely selectable. The numbercould be 1, 2 or any other arbitrary number. The lenses could be convex,could comprise merely one optically projecting functional area, such asa spherical, aspherical or freeform area, or two opposing ones, forexample, to result in a convex or concave lens shape. Also, severaloptically effective lens areas are possible, such as by structuring alens of several materials.

In the embodiment of FIGS. 18a-18c , a first lens 78 a-d of each opticalchannel 16 a-d or optics is formed on the main side 66 a. The lenses 78a-d have been produced, for example, by molding on the main side 66 a ofthe substrate 66 and consist, for example, of polymer, such as UVcurable polymer. The molding takes place, for example by a molding tooland the annealing can, for example, take place via temperature and/orvia UV radiation.

In the embodiment of FIGS. 18a-18c , each optics 64 a-d has a furthersecond and third lens 82 a-d and 84 a-d, respectively. Exemplarily,these lenses are mutually fixed via axially running tube-shaped lensholders 86 a-d inside the respective lens holder and are fixed to themain side 66 b via the latter, such as by means of adhering or anotherjoining technology. Openings 88 a-d of the lens holders 86 a-d areprovided, for example with a circular cross-section in the cylindricalinside of which the lenses 88 a-d and 84 a-d, respectively, are mounted.Thus, for each optics 64 a-d, the lenses are co-axial on the respectiveoptical axis of the optical paths 17 a-d. The lens holders 86 a-d canalso have a cross-section varying across their length and along therespective optical axis, respectively. Here, the cross-section can havean increasingly rectangular or square character with decreasing distanceto the image sensor 12. The outer shape of the lens holders can thusalso differ from the shape of the openings. The material of the lensholders can be light-absorbing. According to the squinting opticsdescribed above in the context of FIGS. 11d and 11e , the lens holderscan also be configured in a non-rotationally symmetric and/ornon-coaxial manner.

Mounting via the above-mentioned lens holders takes, for example, placesuch that lens vertices of the lenses held by the same are spaced apartfrom the substrate 66.

As already mentioned above, it is possible that the substrate 66 isplanar on both sides and hence has no refractive power effect. However,it would also be possible that the substrate 66 comprises mechanicalsubstrates, such as recesses or projections allowing an easy form-fitand/or force-fit alignment of members to be connected, e.g. connectingindividual lenses or housing parts. In the embodiment of FIGS. 18a-18c ,for example, the substrate 66 could have structures easing the mountingor easing the orientation on the main side 6 b at positions where therespective end of the tube of the lens holder 86 a-d of the respectiveoptics 64 a-d is mounted. These structures can, for example be acircular recess or a recess having a different shape corresponding tothe shape of the side of the respective lens holder facing the substratewhich the side of the respective lens holder 84 a-d can engage. Itshould again be emphasized that other opening cross-sections and hencecorrespondingly possibly other lens apertures than circular ones arepossible.

Thus, the embodiment of FIGS. 18a-18c does not have a conventionalstructure of camera modules comprising individual lenses, and forholding the individual lenses, a non-transparent housing carriercompletely enclosing the same. Rather, the above embodiment uses atransparent body 66 as substrate carrier. The same extends acrossseveral adjacent optical channels 16 a-d in order to be penetrated bytheir projecting optical path. The same does not interfere with theprojection but does also not increase the installation height.

However, different options for varying the embodiment of FIGS. 18a-18cshould be noted. For example, the substrate 66 does not necessarilyextend across all channels 16 a-d of the multi-aperture imaging device11. Contrary to what is described above, it would be possible that eachoptics 64 a-d comprises lenses held by lens holders on both sides 66 aand 66 b, as illustrated in FIG. 18 f.

Also, the existence of merely the lenses 82 e-h on the main side 66 a,i.e. without the lenses 82 a-d and/or 84 a-d on the other side 66 bwould be possible, as well as the provision of the lenses 82 a-d and/or84 a-d on the other side 66 a, i.e. the side of the substrate 66 facingaway from the image sensor 12 and not the side facing the same, i.e. 66a. Also, the number of lenses in the lens carriers 86 a-h can be freelyselected. Thus, merely one lens or more than two lenses could exist inone such carrier 86 a-h. As shown in FIG. 18f , it could be possiblethat lenses are mounted on both sides 66 a and 66 b via respective lenscarriers 86 a-d and 86 e-h, respectively, on the respective side 66 aand 66 b, respectively.

FIG. 19 shows exemplarily that the multi-aperture imaging device 11 ofFIGS. 18a-18c could be supplemented by one or several of the additionalmeans described below.

For example, FIG. 19 shows that means 92 could exist for rotating thebeam-deflecting means 18 around the axis of rotation 44 which isparallel to the line-extension direction of the array 14. The axis ofrotation 44 is, for example, within the plane of the optical paths 17a-d or remote from the same by less than a quarter of the diameter ofthe optics 64 a-d. Alternatively, it would also be possible that theaxis of rotation is further apart, such as less than one optics diameteror less than four optics diameters. The means 92 can, for example, beprovided to rotate the beam-deflecting means 18 with short response timein a merely small angular range, such as within a range of less than 1°or less than 10° or less than 20° in order to compensate shaking of themulti-aperture imaging device 11, for example by a user. In this case,the means 92 would be controlled by an image stabilization control.

Alternatively or additionally, means 92 could be configured to changethe direction of the total field of view defined by the total coverageof the partial field of view 74 a-d (FIG. 18a ) with greater angularadjustments. Here, it would further be possible to obtain deflections byrotation of the beam-deflecting means 18 where the total field of viewis arranged in the opposite direction relative to the device 11, forexample by forming the beam-deflecting means 18 as mirror arrayreflective on both sides.

Again, alternatively or additionally, a device 11 can comprise means 94for translationally moving the optics 64 a-d by means of the substrate66 and the substrate 66 itself, and hence the optics 64 a-d,respectively, along the line-extension direction. The means 94 could,for example, also be controlled by the above-mentioned imagestabilization control in order to obtain, by a movement 96 along theline-extension direction, image stabilization transversal to the imagestabilization effected by the rotation of the mirror deflecting device18.

Further, additionally or alternatively, the device 11 can comprise means98 for changing the image-side distance between image sensor 12 andoptics 64 a-d and between image sensor 12 and carrier 66, respectively,for obtaining adjustment of depth of field. The means 98 can becontrolled by manual user control or by autofocus control and focusingmeans of the device 11, respectively.

Thus, the means 94 serves as a suspension of the substrate 66 and maybe, as indicated in FIG. 19, arranged laterally beside the substrate 66along the line-extension direction in order to not increase theinstallation height. It also applies to means 92 and 98 that the samemay be arranged in the plane of the optical paths for not increasing theinstallation height. The means 98 can also be connected to thebeam-deflecting means 18 and can move the same simultaneously or almostsimultaneously such that when changing the image-side distance betweenimage sensor 12 and optics 64 a-d, a distance between optics 64 a-d andbeam-deflecting means 18 remains essentially constant or constant. Themeans 92, 94 and/or 98 can be implemented based on pneumatic, hydraulic,piezoelectric actuators, DC motors, step motors, thermal actuators,electrostatic actuators, electrostrictive and/or magnetostrictiveactuators or drives.

It should be noted that the optics 64 a-d cannot only be held mutuallyin constant relative position, such as via the already mentionedtransparent substrate, but also relative to the beam-deflecting means,such as via a suitable frame advantageously not increasing theinstallation height and thus advantageously running in the plane of thecomponents 12, 14 and 18 and in the plane of the optical paths,respectively. The consistency of the relative position could be limitedto the distance between optics and beam-deflecting means along theoptical axes, such that the means 98 moves, for example, the optics 64a-d together with the beam-deflecting means translationally along theoptical axes. The optics/beam-deflecting distance could be set to aminimum distance, such that the optical path of the channels is notlaterally limited by the segments of the beam-deflecting means 18, whichreduces the installation height, since otherwise the segments 68 a-dwould have to be dimensioned for the greatest optics/beam-deflectingmeans distance as regards to the lateral extension in order to notrestrict the optical path. Additionally, the consistency of the relativeposition of the above-mentioned frames could hold the optics andbeam-deflecting means in a rigid manner to one another along the x axis,such that the means 94 would move the optics 64 a-d together with thebeam-deflecting means translationally along the line-extensiondirection.

The above-described beam-deflecting means 18 for deflecting the opticalpath of the optical channels allows, together with the actuator 92 forgenerating the rotational movement of the beam-deflecting means 18 of anoptical image stabilization control of the multi-aperture imaging device11, image and total field of view stabilization, respectively, in twodimensions, namely by the translational movement of the substrate 66,image stabilization along a first image axis running essentiallyparallel to the line-extension direction, and by generating therotational movement of the beam-deflecting means 18, image stabilizationalong a second image axis running essentially parallel to the opticalaxes prior to and without beam-deflecting, respectively, or, when thedeflected optical axes are considered, perpendicular to the optical axesand the line-extension direction. Additionally, the describedarrangements can effect translation movement of the beam-deflectingmeans and array 14 fixed in the stated frame perpendicular to theline-extension direction, such as by the described actuator 98, whichcan be used for realizing focus adjustment and hence autofocus function.

As an alternative to or in addition to the rotational movement forobtaining image stabilization along the second image axis, also, atranslational relative movement between the image sensor 12 and thearray 14 can be implemented. This relative movement can be provided, forexample, by the means 94 and/or the means 98.

For completeness sake, it should be noted with respect to the abovestatements that the device when capturing via the image sensor areascaptures one image of a scene per channel which are projected by thechannels on the image sensor areas, and that the device can optionallyhave a processor that assembles or joins the images to a total imagecorresponding to the scene in a total field view and/or providesadditional data, such as 3D image data and depth information of theobject scene for generating depth maps and for software realization,such as refocusing (determining the image sharpness regions after theactual capturing), all-in-focus images, virtual green screen (separationof foreground and background), etc. The latter tasks could also beperformed by the processor or externally. The processor, however, couldalso represent a component external to the multi-aperture imagingdevice.

FIG. 20a illustrates that devices 11 of the above-described alternativescan be installed, for example in a flat housing of a portable device130, such as a mobile phone, a smartphone or media player or the same,wherein then, for example, the planes of the image sensor 12 and theimage sensor areas, respectively and the lens planes of the optics ofthe optical channels 16 are oriented perpendicular to the flat extensiondirection of the flat housing and parallel to the thickness direction,respectively. In that way, for example, the beam-deflecting means 18would have the effect that the total field of view of the multi-apertureimaging device 11 is in front of a front side 102 of the flat housingwhich also comprises, for example, a monitor. Alternatively, adeflection would also be possible such that the field of view is infront of a rear side of the flat housing opposing the front side 102.The housing 22 of the device 130 and the device itself, respectively,can be flat, since, due to the illustrated position of the device 11 inthe housing, the installation height of the device 11, which is parallelto the thickness of the housing, can be kept low. Switchability couldalso be provided in that a window is provided on the side opposing theside 102 and, for example, the beam-deflecting means is moved betweentwo positions, wherein the latter is implemented, for example, as mirrormirroring on the front and rear and rotated from the one to the otherposition, or as a facet mirror having a set of facets for the oneposition and another set of facets for the other position, wherein thesets of facets are beside one another in line-extension direction andswitching between the position takes place by translationally moving thebeam-deflecting means back and forth along the line-extension direction.Installation of the device 11 into a different, possibly non-portabledevice, such as a car, would also be possible.

Several modules 11 whose partial field of view of their channels coverthe same field of view completely and optionally even congruently can beinstalled in the device 130 with a base distance BA (cf. FIG. 14) to oneanother along a line-extension direction which is the same for bothmodules, such as for the purpose of stereoscopy. More than two moduleswould also be possible. The line-extension directions of the modules 11could also be non-collinear and merely parallel to one another. However,it should be noted again that, as mentioned above, also a device 11 anda module, respectively, could be provided with channels such that thesame completely cover the same total field of view in groups. Themodules can be arranged in one/several line(s)/row(s) or any position ofthe device. When several modules are arranged, the same can be formed inthe same manner or differently. A first module can be configured, forexample, to perform stereoscopic capturing of the total field of view. Asecond module can be configured to perform simple capturing,stereoscopic capturing or higher order capturing.

It should be noted that in alternative embodiments the beam-deflectingmeans could also be omitted in comparison to the above-describedembodiments. When merely partial mutual overlapping of the partial fieldof use is desired, this could be obtained, for example, via mutuallateral offsets between the center of the image sensor area and theoptical center of the optics of the respective channel. Obviously, theactuators according to FIG. 19 could still be used, wherein, as asubstitute for the means 92, for example, the actuator 94 isadditionally able for translationally moving the optics and the carrier66, respectively.

Again, in other words, the above embodiments show a multi-apertureimaging device with single-line array of juxtaposed optical channelswhere somewhere in the optical path of the multi-aperture imaging devicea substrate, for example of glass or polymer, extending across thechannel extends for improving the stability. Additionally, the substratecan include lenses on the front and/or rear side. The lenses can be madeof the material of the substrate (such as produced by hot stamping) ormolded thereon. Further lenses, which are not on the substrate and areindividually mounted, can be in front of and behind the substrate.Several substrates can exist in one structure, both along as well asperpendicular to the line-extension direction. Here, it would also bepossible to connect several substrates with lenses along the opticalpaths in series, i.e. to keep the same in a predetermined positionalrelation to one another in a different way, such as via a frame withoutnecessitating any joining action. In that way, twice as many main sideswould be available for providing or mounting lenses, as carriersubstrates are used, such as a substrate 66 which can be loaded withlenses according to the above examples, here exemplarily according toFIG. 18b , and the substrate which can also be loaded with lensesaccording to the above embodiments, i.e. among others with lenses thatare mounted on the main sides 66 a and/or 66 b via lens holders, buthere exemplarily illustrated integrally produced, for example byinjection molding or the same, such that lenses are formed on both sides66 a and 66 b, although also molded lenses of different materials thanthe material of the parallelepiped-shaped substrate 66 would be possibleas well as lenses on only one of the sides 66 a or 66 b. Both substratesare transparent and are penetrated by the optical paths, through themain sides 66 a and 66 b. Thus, the above embodiments can be implementedin the form of a multi-aperture imaging device with single-line channelarrangement, wherein each channel transmits a partial field of view of atotal field of view and the partial fields of view partly overlap. Astructure having several such multi-aperture imaging devices for stereo,triple, quadruple, etc. structures for 3D image capturing is possible.Here, the plurality of modules can be implemented as one contiguousline. The contiguous line could use identical actuators and a commonbeam-deflecting element. One or several mechanically enforcingsubstrates possibly existing within the optical path can extend acrossthe total line which can form a stereo, triple, quadruple structure.Methods of superresolution can be used, wherein several channels projectthe same partial image areas. The optical axes can also already run in adivergent manner without beam-deflecting means, such that fewer facetsare used on the beam-deflecting unit. Then, advantageously, the facetshave only one angular component. The image sensor can be integral, cancomprise only one contiguous pixel matrix or several interrupted ones.The image sensor can be composed of many partial sensors that are, forexample, juxtaposed on a printed circuit board. An autofocus drive of afocusing means can be implemented such that the beam-deflecting elementis moved synchronously with the optics or is stationary. When nopre-divergence exists, embodiments provide for the optical paths runningessentially or completely parallel between the image sensor 12 and thebeam-deflecting means 18.

FIG. 20b shows a schematic structure including a first multi-apertureimaging device 11 a and a second multi-aperture imaging device 11 b asit can be arranged, for example in the device 130. The twomulti-aperture imaging devices 11 a and 11 b can form a commonmulti-aperture imaging device 11 and can comprise a common image sensor12 and/or a common array 14. The single-line arrays 14 a and 14 b form,for example, a common line in the common array 14. The image sensors 12a and 12 b can form the common image sensor 12 and can be mounted, forexample, on a common substrate and on a common circuit carrier, such asa common printed circuit board or a common flexboard. Alternatively, theimage sensors 12 a and 12 b can also include differing substrates.Different combinations of these alternatives are also possible, such asmulti-aperture imaging devices including a common image sensor, a commonarray and/or a common beam-deflecting means 18 as well as furthermulti-aperture imaging devices comprising separate components. It is anadvantage of a common image sensor, a common single-line array and/or acommon beam-deflecting means that a movement of a respective componentcan be obtained with high precision by controlling a small amount ofactuators and synchronization between actuators can be reduced orprevented. Further, high thermal stability can be obtained.Alternatively or additionally, further multi-aperture imaging devicescan also comprise a common array, a common image sensor and/or a commonbeam-deflecting means. The structure of the multi-aperture imagingdevice 11 can be used, for example for stereoscopic capturing of a totalor partial field of view when optical channels of different partialmulti-aperture imaging devices 11 a and 11 b are directed on the samepartial field of view. Comparably, further partial multi-apertureimaging devices can be integrated in the common multi-aperture imagingdevices, such that capturing of a higher order than stereo is possible.

FIG. 21 shows a 3D multi-aperture imaging device 140 as it can be usedaccording to embodiments described herein. The same has an image sensorwhich can be divided into two components 12 ₁ and 12 ₂, respectively, asindicated in FIG. 21, a component 12 ₁ for the “right” optical channels16 ₁ and the other component 12 ₂ for the “left” channels 16 ₂. Theright and left optical channels 16 ₁ and 16 ₂ are structured identicallyin the example of FIG. 21, but arranged laterally offset from oneanother by the base distance BA in order to obtain as much depthinformation as possible with regard to the scene within the field ofview of the device 140. For example, the 3D multi-aperture imagingdevice can be formed by two or more multi-aperture imaging devices 11.Thus, the elements provided with a reference number having an index 1 atthe first position from the left belong to the first component 1 or afirst module for the right channels, module 1, of the device 140 and theelements with a reference number having an index 2 at the first positionfrom the left belong thus to the second component 2 or a second modulefor the left channels, module 2, of the device 140. Although the numberof modules in FIG. 21 is 2, the device could also have more that arearranged with a respective base distance to one another.

In the exemplary case of FIG. 21, each plurality 16 ₁ and 16 ₂ ofoptical channels comprises four juxtaposed optical channels. Theindividual “right” channels are differentiated by the second subscriptindex. The channels are indexed from right to left, i.e. the opticalchannel 16 ₁₁ not illustrated in FIG. 21 due to a partial omission forclarity purposes is arranged, for example, along the base distancedirection 108 along which the left and right channels are arrangedoffset from one another by the base distance BA at the outer right edge,i.e. furthest apart from the plurality 16 ₂ of left channels, whereinthe other right channels 16 ₁₂-16 ₁₄ follow along the base distancedirection 108. Thus, the channels 16 ₁₁-16 ₁₄ form a single-line arrayof optical channels whose line-extension direction corresponds to thebase distance direction 108. The left channels 16 ₂ are structured inthe same way. The same are also differentiated by the second subscriptindex. The left channels 16 ₂₁-16 ₂₄ are arranged beside one another andin the same direction subsequent to one another like the right channels16 ₁₁-16 ₁₄, namely such that the channel 16 ₂₁ is closest to the rightchannels and the channels 16 ₂₄ furthest apart from the latter.

Each of the right channels 16 ₁₁-16 ₁₄ includes respective optics thatcan consist, as indicated in FIG. 21, of one lens system. Alternatively,each channel could comprise a lens. Each optical channel 16 ₁₁-16 ₁₄captures one of overlapping partial fields of view 74 a-d of the totalfield of view 72 which overlap as described in the context of FIG. 21a .The channel 16 ₁₁ projects, for example, the partial field of view 74 ₁₁on an image sensor area 58 ₁₁, the optical channel 16 ₁₂ the partialfield of view 74 ₁₂ on an image sensor area 58 ₁₂, the optical channel16 ₁₃ an allocated partial field of view 741 ₃ on a respective imagesensor area 58 ₁₃ of the image sensor 12 not visible in FIG. 21, and theoptical channel 16 ₁₄ an allocated partial field of view 74 ₁₄ on arespective image sensor area 58 ₁₄ which is also not shown in FIG. 21since the same is covered.

In FIG. 21, the image sensor areas 58 ₁₁-58 ₁₄ of the image sensor 12and the component 12 ₁ of the image sensor 12, respectively, arearranged in a plane parallel to the base distance direction BA andparallel to the line-extension direction 108, respectively, and the lensplanes of the optics of the optical channels 16 ₁₁-16 ₁₄ are alsoparallel to this plane. Additionally, the image sensor areas 58 ₁₁-58 ₁₄are arranged with a lateral inter-channel distance 110, by which theoptics of the optical channels 16 ₁₁-16 ₁₄ are also arranged in thisdirection, such that the optical axes and optical paths of the opticalchannels 16 ₁₁-16 ₁₄ run parallel to one another between the imagesensor areas 58 ₁₁-58 ₁₄ and the optics 16 ₁₁-16 ₁₄. For example,centers of the image sensor areas 58 ₁₁-58 ₁₄ and optical centers of theoptics of the optical channels 16 ₁₁-16 ₁₄ are arranged on therespective optical axis which run perpendicular to the above-mentionedcommon plane of the image sensor areas 58 ₁₁-58 ₁₄.

The optical axes and optical paths, respectively, of the opticalchannels 16 ₁₁-16 ₁₄ are deflected by a beam-deflecting means 18 ₁ andhence provided with a divergence, which has the effect that the partialfields of view 74 ₁₁-74 ₁₄ of the optical channels 16 ₁₁-16 ₁₄ onlyoverlap partly, such that, for example, the partial fields of view 74₁₁-74 ₁₄ overlap at the most by 50% in the spatial angular sense. Asindicated in FIG. 21, the beam-deflecting means 181 can comprise, forexample for each optical channel 16 ₁₁-16 ₁₄ a reflective facet whichare tilted with respect to one another differently among the channels 16₁₁-16 ₁₄. An average inclination of the reflective facets with respectto the image sensor plane deflects the total field of view of the rightchannels 16 ₁₁-16 ₁₄ in a direction that is, for example, perpendicularto the plane in which the optical axes of the optics of the opticalchannels 16 ₁₁-16 ₁₄ run prior to and without beam-deflection,respectively, by the device 181, or deviates from this perpendiculardirection by less than 10°. Alternatively, the beam-deflecting means 181could also use prisms for beam-deflection of the individual optical axesand optical paths, respectively of the optical channels 16 ₁₁-16 ₁₄.

The beam-deflecting means 181 provides the optical paths of the opticalchannels 16 ₁₁-16 ₁₄ with a divergence such that the channels 16 ₁₁-16₁₄, actually disposed beside one another in linear way in the direction108, cover the total field of view 72 in a two-dimensional manner.

It should be noted that the optical paths and optical axes,respectively, could also deviate from the described parallelism, butthat the parallelism of the optical paths of the optical channels couldstill be so distinct that the partial fields of view covered by theindividual channels 16 ₁₁-16 ₁₄ and projected on the respective imagesensor areas 58 ₁₁-58 ₁₄, respectively, would mostly overlap without anyfurther measures, such as beam-deflection, so that in order to cover agreater total field of view by the multi-aperture imaging device 140 thebeam-deflecting means 18 provides the optical paths with additionaldivergence such that the partial fields of view of the channels 16 ₁₁-16₁₄ overlap less. The beam-deflecting means 18 ₁ has, for example, theeffect that the total field of view has an aperture angle averaged overall azimuthal angles and over all transversal directions, respectively,which is greater than 1.5 times the respective average aperture angle ofthe partial fields of view of the optical channels 16 ₁₁-16 ₁₄.

The left channels 16 ₂₁-16 ₂₄ are structured in the same way as theright channels 16 ₁₁-16 ₁₄ and positioned relative to the respectiveallocated image sensor areas 58 ₂₁-58 ₂₄, wherein the optical axes ofthe optical channels 16 ₂₁-16 ₂₄ running parallel to one another in thesame plane as the optical axes of the channels 16 ₁₁-16 ₁₄ are deflectedby a corresponding beam-deflecting means 18 ₂, such that the opticalchannels 16 ₂₁-16 ₂₄ capture the same total field of view 72 almostcongruently namely in partial fields of view 74 ₂₁-74 ₂₄ into which thetotal field of view 72 is two-dimensionally divided, which overlap, andeach of which overlaps almost completely with the respective partialfield of view 74 ₁₁-74 ₁₄ of a respective channel of the right channels16 ₁₁-16 ₁₄. For example, the partial field of view 74 ₁₁ and thepartial field of view 74 ₂₁ overlap almost completely, the partialfields of view 74 ₁₂ and-74 ₂₂ etc. The image sensor areas 58 ₁₁-58 ₂₄can, for example, each be formed of one chip as described for the imagesensor 12 in FIG. 18.

In addition to the above-mentioned components, the 3D multi-apertureimaging device comprises a processor 112 having the task of merging theimages that have been captured when capturing by the 3D multi-apertureimaging device 10 by the right optical channels 16 ₁₁-16 ₁₄ to a firsttotal image. The problem that has to be addressed is the following: dueto the inter-channel distances 110 between adjacent channels of theright channels 16 ₁₁-16 ₁₄, the images that have been captured duringcapturing by the channels 16 ₁₁-16 ₁₄ in the image areas 58 ₁₁-58 ₁₄cannot be simply and translationally moved with respect to one anotherand placed on top of one another. In other words, the same cannot easilybe joined. The lateral offset along direction B, 108 and 110,respectively, in the images of the image sensor areas 58 ₁₁-58 ₁₄ whencapturing the same scene, that correspond to one another but that residein different images is called disparity. The disparity of correspondingimage contents depends again on the distance of this image contentwithin the scene, i.e. the distance of the respective object from thedevice 140. The processor 112 could try to evaluate disparities amongthe images of the image sensor areas 58 ₁₁-58 ₁₄ itself in order tomerge these images with one another to a first total image, namely a“right total image”. However, it is a disadvantage that theinter-channel distance 110 does exist and therefore causes the problem,but that the inter-channel distance 110 is also relatively low such thatthe depth resolution and estimation, respectively, is merely inaccurate.Therefore, the attempt of determining corresponding image content in anoverlap area between two images, such as in the overlap area 114 betweenthe images of the image sensor areas 58 ₁₁-58 ₁₂, for example, by meansof correlation is difficult.

Thus, for merging, the processor of FIG. 21 uses, in the overlap area114 between the partial fields of view 74 ₁₁ and 74 ₁₂, disparities in apair of images, one of which has been captured by one of the leftchannels 16 ₂₁ or 16 ₂₂, whose projected second partial field of view,namely 74 ₂₁ and 74 ₂₂, respectively, overlaps with the overlap area114. For example, the process 112 for merging the images of the imagesensor areas 58 ₁₁ and 58 ₁₂ evaluates disparities in images, one ofwhich has been captured by one of the image sensor areas 58 ₂₁ or 58 ₂₂and another one by a channel involved in the overlap area 140, i.e. animage that has been captured by one of the image sensor areas 58 ₁₁ or58 ₁₂. Then, such a pair has a base distance from the base distance BAplus/minus one or no channel based distance 110. The latter basedistance is significantly greater than a single channel base distance110, which is why the disparities are easier to be determined in theoverlap area 86 for the processor 112. Thus, for merging the images ofthe right channels, the processor 112 evaluates disparities that resultwith an image of the left channels and advantageously, but notexclusively, between images of one of the right channels and one of theleft channels.

More specifically, it is possible that the processor 112 takes that partof the partial field of view 74 ₁₁ that does not overlap with any of theother partial fields of view of the right channels more or less directlyfrom the image 58 ₁₁ and performs the same for the non-overlapping areasof the partial fields of view 74 ₁₂, 74 ₁₃, and 74 ₁₄ based on theimages of the image sensor areas 58 ₁₂-58 ₁₄, wherein the images of theimage sensor areas 58 ₁₁-58 ₁₄ have, for example, been capturedsimultaneously. Merely in the overlap areas of adjacent partial fieldsof view, such as the partial fields of view 74 ₁₁ and 74 ₁₂, theprocessor 112 uses disparities of image pairs whose overlap in the totalfield of view 72 does overlap in the overlap area, but wherein theplurality but not merely one of them has been captured by one of theright channels and the other one by one of the left channels, such asagain at the same time.

However, according to an alternative procedure, it would also bepossible that the processor 112 warps all images of the right channelaccording to an evaluation of disparities between pairs of images whereone of them has been captured by the right channels and the other one bythe left channels. In that way, for example, the total image that iscalculated by the processor 112 for the images of the right channelscould be virtually “warped” not only in the overlap area of the partialfields of view 74 ₁₁-74 ₁₄ of the right channels but also in thenon-overlap area in a virtual manner on a focal point which is, forexample, laterally in the center between the right channels 16 ₁₁-16 ₁₄by evaluating, also for those areas of the partial fields of view 74₁₁-74 ₁₄ that do not overlap, disparities of image pairs by theprocessor 85 where one image has been captured by one of the rightchannels and another image by one of the left channels.

The 3D multi-aperture imaging device 140 of FIG. 21 is not only able togenerate a total image from the images of the right channel, but the 3Dmulti-aperture imaging device 140 of FIG. 21 is also able, in oneoperating mode, to generate, in addition to the total image of the firstchannels, also a total image of the images of the left channels and/orto generate, in addition to the total image of the right channels, adepth map.

According to the first alternative, the processor 112 is, for example,configured to merge images captured by the left optical channels 16₂₁-16 ₂₄ and the image sensor areas 58 ₂₁-58 ₂₄ to a second total image,namely a total image of the left channel and to thereby use, in anoverlap area of laterally adjacent ones of the partial fields of view 74₂₁-74 ₂₄ of the left optical channels, disparities in a pair of images,the plurality of which but not only one has been captured by a rightoptical channel 16 ₁₁-16 ₁₄ and overlaps with the respective overlaparea of the pair of partial fields of view 74 ₂₁-74 ₂₄, and the otherone may be captured by one of the left optical channels whose partialfield of view overlaps with the respective overlap area.

Thus, according to the first alternative, the processor 112 outputs twototal images for one capturing, namely one for the right opticalchannels and the other for the left optical channels. These two totalimages could be supplied, for example, to the two eyes of a userseparately and hence result in a three-dimensional impression of thecaptured scene.

According to the other above-mentioned alternative, the processor 112generates, in addition to the total image of the right channels a depthmap, by using disparities in pairs of images comprising at least onepair at least for each of the right channels 16 ₁₁-16 ₁₄ comprising animage captured by the respective right channel and a further imagecaptured by one of the left channels.

In one embodiment, where the depth map is generated by the processor112, it is also possible to perform the above-mentioned warping for allthe images that have been captured by the right channels based on thedepth map. Since the depth map comprises depth information across thetotal field of view 72, it is possible to warp all the images that havebeen captured by the right channels, i.e. not only in the overlap areasof the same but also in the non-overlap areas, on a virtual commonaperture point and a virtual optical center, respectively.

The two alternatives could also both be processed by the processor 112.The same could first generate, as described above, the two total images,namely one for the right optical channels and the other for the leftoptical channels by using, when merging the images of the right channelsin the overlap areas between the images of the right channels alsodisparities from pairs of images where one of them belongs to the imagesof the left channels, and by using, when merging the images of the leftchannels in the overlap areas between the images of the left channels,also disparities from pairs of images where one of them belongs to theimages of the right channels in order to generate then, from the totalimages obtained in that manner which represent the scene in the totalfield of view from different perspectives, a total image with anallocated depth map, such as a total image that lies between the opticalcenters of the optics of the right and left optical channels, butpossibly not exclusively in the center between the same, for a virtualview and for a virtual optical center, respectively. For calculating thedepth map and for warping one of the two total images or warping andmerging both total images in the virtual view, the processor 85 wouldthen use the right and left total image, virtually as intermediateresult from the previous merging of the left and right individualimages, respectively. Here, the processor evaluated disparities in thetwo intermediate result total images in order to obtain the depth mapand to perform warping or warping/merging of the same.

It should be noted that the processor 112 performs evaluation ofdisparities in a pair of images, for example, by means ofcross-correlation of image areas.

It should be noted that in a different coverage of the total field ofview 72 by the partial fields of view of the left channels on the onehand and by the partial fields of view of the right channels on theother hand, possibly more than four channels (irrespective of theirallocation to the left or right channels) overlap, as it was the case,for example, also at the mutual overlap between the overlap areas ofpartial fields of view adjacent in line direction or column direction ofthe previous examples, where the partial fields of view of the rightchannels as well as the partial fields of view of the left channels wereeach arranged in columns and lines. It applies generally to the numberof disparity sources that the same are (₂ ^(N)), wherein N relates tothe number of channels with overlapping partials fields of view.

In addition to the above description, it should be noted that theprocessor 112 optionally also performs channel-by-channel correction ofperspective projection faults of the respective channel.

It should be noted that the embodiment of FIG. 21 has been exemplary inmany ways. This concerns, for example, the number of optical channels.The number of right optical channels might not be four but is somehowgreater than or equal to 2 or is between 2 and 10, both inclusive, andthe overlap area of the partial fields of view of the right opticalchannels can, as far as for each partial field of view or each channelthe pair with the greatest overlap to the respective partial field ofview is considered, can be, in terms of surface area for all thesepairs, between ½ and 1/1000 of an average image size of the imagescaptured by the image areas 58 ₁₁-58 ₁₄, measured, for example, in theimage plane, i.e., the plane of the image sensor areas. The sameapplies, for example, to the left channels. However, the number candiffer between the right channels and the left channels. This means thatthe number of left optical channels, N_(L), and right optical channels,N_(R), does not have to be the same and a division of the total field ofview 72 into the partial fields of view of the left channels and thepartial fields of view of the right channels does not have to beapproximately the same as it was the case in FIG. 21. Concerning thepartial fields of view and their overlap it can be such that the partialfields of view project into one another but at least 20 pixel, as longas an image distance and object distance, respectively, of 10 m isconsidered, for all pairs having a greater overlap, wherein this canapply both to the right channels as well as to the left channels.

In contrary to the above statements it is not necessary that the leftoptical channels and the right optical channels, respectively, areformed in a single line. The left and/or the right channels can alsoform a two-dimensional array of optical channels. Additionally, it isnot necessary that the single-line arrays have a collinearline-extension direction. However, the arrangement of FIG. 21 isadvantageous since the same results in a minimum installation heightperpendicular to the plane in which the optical axes of the opticalchannels, i.e., both the right and the left channels run prior to andwithout beam deflection, respectively. Concerning the image sensor 12 ithad already been mentioned that the same can be formed of one, two orseveral chips. For example, one chip could be provided per image sensorarea 58 ₁₁-58 ₁₄ and 58 ₂₁-58 ₂₄, wherein in the case of several chipsthe same can be mounted on one or several printed circuit boards, suchas one printed circuit board for the left channels and the image sensorsof the left channels, respectively, and one printed circuit board forthe image sensors of the right channels.

Thus, in the embodiment of FIG. 21 it is possible to place adjacentchannels within the channels of the right or left channels as densely aspossible, wherein in the optimum case the channel distance 110corresponds to the lens diameter. This results in a low channel distanceand hence low disparity. The right channels on the one hand and the leftchannels on the other hand can, however, be arranged at any distance BAto one another, such that great disparities can be realized. All in all,there is the option of artefact-reduced or artefact-free image fusionand a production of depth maps with a passive optical imaging system.

Compared to the above examples it would be possible to use more thanonly two groups of channels 16 ₁ and 16 ₂. The number of groups could beindicated by N. If in this case the number of channels per group werethe same, and the total field of view division into partial fields ofview were also the same for all groups, a number of disparity sources of(₂ ^(2N)), for example, would result per overlap area of partial fieldsof view of the group 161. A different total field of view division forthe groups of channels is also possible as has already been mentionedabove.

Finally, it should be noted that in the above description merely theexemplary case that the processor 112 merges the image of the rightchannels has been used. The same process could be performed by theprocessor 112, as mentioned above, for both and all channel groups,respectively, or also for the left one or the same.

FIG. 22a shows an embodiment of a multi-aperture imaging device 150.Advantageously, the image sensor areas 58 a-d are arranged in a commonplane, namely the image plane of the optical channels 16 and theiroptics, respectively. In FIG. 22a , this plane is exemplarily parallelto the plane spanned by a z and a y axis of a Cartesian coordinatesystem which is, for simplifying the following description, shown inFIG. 22a and provided with the reference number 115.

In a linear array of optical channels, the extension of themulti-aperture imaging device 150, as it is limited by the image sensor12 and the optics 64 towards the bottom, is greater along theline-extension direction than the diameter of a lens. The minimumextension of the multi-aperture imaging device 150, as it is determinedby the mutual arrangement of image sensor 12 to optics 64 along the zaxis, i.e., along the optical axes and optical paths of the opticalchannels 16 a-d, is smaller than the minimum extension along the z axis,but due to the implementation of the optical channels 16 a-d as asingle-line array, the same is greater than the minimum expansion of themulti-aperture imaging device in the lateral direction y perpendicularto the line-extension direction z. The latter is given by the lateralextension of each individual optical channel 16 a-d, such as theextension of the optics 64 a-d along the y axis, possibly including theholder 66.

As described above, in the embodiment of FIG. 22a , the optical axes 17a-d are parallel to another prior to and without the deflection by thebeam-deflecting means 18, respectively, for example, at the optics 64a-d, respectively, as shown in FIG. 22a , or the same only deviateslightly therefrom. The corresponding centered positioning of optics 64a-d as well as the image sensor areas 58 a-d is easy to produce andfavorable as regards to minimizing the installation space. Theparallelism of the optical paths of the optical channels has also theeffect that the partial fields of view covered by the individualchannels 16 a-d and projected on the respective image sensor areas 58a-d, respectively would overlap almost completely without any furthermeasures, such as beam deflection. In order to cover a greater totalfield of view by the multi-aperture imaging device 150, a furtherfunction of the beam-deflecting means 18 is to provide the optical pathswith divergence such that the partial fields of view of the channels 16a-d overlap less.

It is assumed, for example, that the optical axes 17 a-d of the opticalpaths of the optical channels 16 a-d are parallel to one another priorto and without the beam-deflecting means 18, respectively, or deviate,with regard to a parallel alignment along the alignment averaged acrossall channels, by less than a tenth of a minimum aperture angle of thepartial fields of view of the optical channels 16 a-d. Withoutadditional measures, the partial fields of view would largely overlap.Thus, the beam-deflecting means 18 of FIG. 22a includes, for eachoptical channel 16 a-d, a reflecting facet 68 a-d clearly allocated tothis channel, which are each optically planar and tilted with respect toone another, namely such that the partial fields of view of the opticalchannels overlap less with regards to the solid angle and cover, forexample a total field of view having an aperture angle that is, forexample, greater than 1.5 times the aperture angle of the individualpartial fields of view of the optical channels 16 a-d. In the exemplarycase of FIG. 22a , the mutual inclination of the reflective facets 68a-d has, for example, the effect that the optical channels 16 a-d thatare actually arranged linearly juxtaposed along the z axis cover thetotal field of view 72 according to a two-dimensional arrangement of thepartial fields of view 74 a-d.

If, in the embodiment of FIG. 22a , the angular deflection of theoptical axes 17 a-d of the optical channels 16 a-d is considered in theplane spanned by the averaged direction of the optical axes prior tobeam deflection and the averaged direction of the optical axes afterbeam deflection, i.e., in the zy plane in the example of FIG. 22a on theone hand and in the plane running perpendicular to the latter plane andparallel to the averaged direction of the optical axes after beamdeflection on the other hand, the example of FIG. 22a corresponds to theexemplary case that the averaged direction after beam deflectioncorresponds to the y axis. Thus, on average, the optical axes of theoptical channels are deflected by 90° in the yz plane around the z axisand, on average, the optical axes are not tiled out of the yz plane.

For example, β_(x) ¹ indicates the inclination angle of the facet 68 awith respect to the xz plane measured in the xy plane, i.e., tilting ofthe facet 68 a around the z axis with respect to the xz plane in whichthe optical axes 17 a-d run. β_(z) ¹=0° corresponds to an alignment ofthe facet 68 a parallel to the xz plane. Accordingly, α_(z) ¹=2·β_(z) ¹applies. Accordingly, N defines the inclination angle of the facet 68 awith respect to a plane having the inclination β_(z) ¹ with respect tothe xz plane and running parallel to the z axis measured along the zaxis. Therefore, α_(x) ¹=2·β_(x) ¹ applies accordingly. The samedefinitions apply for the other channels: α_(x) ¹=2·β_(x) ^(i), α_(z)^(i)=2·β_(z) ^(i). For each optical channel, the setting angle can begreater than an inclination angle of the inclination of the reflectingfacet allocated to this channel with respect to carrier substratethrough which the optical channels run. Here, the carrier substrate canbe positioned parallel to a line-extension direction of the array 14 andthe setting angle can be in a plane perpendicular to the line-extensiondirection.

FIGS. 22b-22e show side views of a beam-deflecting device according toan embodiment for exemplarily four optical channels that are arrangedlinearly or unilaterally, respectively. The beam-deflecting device 18 ofFIG. 22b-229e could be used as beam-deflecting device of FIG. 18a ,wherein then the partial fields of view would not cover the total fieldof view clockwise 3, 4, 2, 1 as illustrated in FIG. 18a , but clockwisein the order 4, 2, 1, 3. The inclination angles of the facets 68 a-d areindicated in FIG. 22b-e . The same are differentiated by superscriptindices 1-4 and allocated to the respective channel, respectively. Here,both and are 0°. The rear side of the carrier substrate, i.e., the sideopposing the surface provided with the facets 68 a-d is indicated inFIG. 22b-22e by 12 ₁. The material forming the parallelepiped-shapedportion of the carrier substrate 123 is below the dotted line 125. It isobvious that the additional material added to the same has little volumesuch that molding is eased.

The carrier substrate 123 is placed inclined by a setting angle α_(x) ⁰with respect to the image sensor 12, namely around the axis around whichthe average direction of the optical axes of the optical channels isdeflected, i.e., the z axis in FIG. 22a . This setting angle has theeffect that the surface of the beam-deflecting device 18 facing theimage sensor 12 already effects “coarse deflection” of the optical pathsof the optical channels.

For the deflecting angles of the deflection of the optical path of eachoptical channel by the beam-deflecting means 18, this means that thesame are each based on the setting angle α_(x) ⁰ as well as on therespective inclination of the reflecting facet allocated to the opticalchannel with respect to the carrier substrate 123 itself. Thesementioned facet-individual inclinations of the facets 68 a-d can bedefined, as described above, by an inclination angle in the xy plane andan inclination angle with respect to the normal of the carrier substrate123 in the plane perpendicular thereto. It is of advantage when itapplies that, for each channel, the setting angle α_(x) ⁰ is greaterthan the inclination, i.e., α_(x) ⁰>max(|β_(x)|, |β_(z)|) for allchannels. It is of even more advantage when said inequality is fulfilledalready for α_(x) ⁰/2 or even for α_(x) ⁰/3. In other words, it is ofadvantage when the setting angle is great compared to the inclinationangles of the facets 68 a-d, such that the additional material comparedto a pure parallelepiped-shape of the beam-deflecting device 18 is low.α_(x) ⁰ can, for example, lie between 30° and 60°, each inclusive.

Production of the beam-deflecting means 18 of FIG. 22b-22e can beperformed, for example, in that the additional material is molded on thecarrier substrate 123 by a molding tool. Here, the carrier substrate 123could, for example, be glass while the molded additional materialthereon is polymer. A further option is forming the beam-deflectingdevice 18 of FIG. 22b-22e integrally by injection molding or the same.This has the effect that the surface of the beam-deflecting means facingthe image sensor is mirrored at least on the reflecting facets allocatedto the optical channels. The carrier substrate can be pivoted asdescribed, for example, in the context of FIG. 11 b.

Some aspects of the structure of the multi-aperture imaging devicedescribed so far relate, so to speak, to a desired or instantaneoussetting prior to or at the time of capturing a total image, for example.The multi-aperture imaging device 150 of FIG. 22a includes, for example,a processor, such as the processor 112 that merges images that have beencaptured by the image sensor areas 58 a-d at, for example, the sametime, with the above mentioned settings, to a total image representingthe scene in the total field of view 72. The algorithm used by theprocessor 112 to join or merge the images projected by the opticalchannels 16 a-d on the image sensor areas 58 a-d and captured by thelatter is, for example, designed such that assumptions on maintainingspecific parameters of the above-described components of themulti-aperture imaging device 150 should be complied with such that thequality of the total image fulfils certain specifications or thealgorithm can be applied at all. For example, the algorithm assumescompliance with one or several of the following assumptions:

-   1) The optics to image sensor area distances along the x axis are    the same for all optical channels 16 a-d;-   2) The relative location of the partial fields of view 74 a-d and in    particular the overlap between the same corresponds to a    predetermined specification or deviates from the same by less than a    predetermined maximum deviation.

For various reasons, it can be the case that one or several of the abovestated assumptions are not complied with or are not complied withsufficiently. Reasons for not complying with the same could, forexample, be production tolerances, such as inaccuracies of the relativelocations of the optics 64 a-d to one another and relative to the imagesensor 12. Production inaccuracies can also include an inaccuracy of theinstallation of the beam-deflecting device 18 and possibly the relativelocations of the facets 68 a-d to one another when the beam-deflectingmeans 18 comprises facets 68 a-f. In addition to or as an alternative tothe production-induced tolerance deviations, temperature variations canhave the effect that one or several of the above stated assumptions doesnot apply or is not sufficiently complied with.

To some degree, the algorithm for joining and merging, respectively, theimages of the image sensor areas 58 a-d to the total image executed bythe processor 112 can possibly compensate deviations from an optimumalignment and arrangement of the components, such as deviations of thepositions of the partial fields of view 74 a-d within the total field ofview 72 from a set constellation of relative locations of the partialfields of view to one another. When joining and merging, respectively,the images, the processor 112 could compensate, for example, suchdeviations to a certain degree. However, when specific deviation limitsare exceeded (not complying with assumption 2), the processor 112 would,for example, not be able to compensate the deviations.

Producing the multi-aperture imaging device 150 such that theabove-mentioned assumptions are complied with, such as across a specifictemperature range, has the tendency of increasing production costs ofthe multi-aperture imaging device 150. In order to prevent this, themulti-aperture imaging device 150 of FIG. 22a includes an adjustmentmeans 116 for channel-individually changing a relative location betweenthe image sensor area 58 i of a respective optical channel 16 i, theoptics 64 i of the respective optical channel 16 i and thebeam-deflecting means 18 and the respective segment 68 i of the same, orfor channel-individually changing an optical characteristic 16 i or anoptical characteristic of the segment 68 i of the beam-deflecting means18 relating to the deflection of the optical path of the respectiveoptical channel. The adjustment means 116 is controlled by defaultvalues and performs the adjustment tasks according to the defaultvalues. The same are provided by a memory 118 and/or a control 122 thatwill be discussed below.

The device 150 comprises, for example, a memory 118 with stored defaultvalues for channel-individual control of the adjustment means 116. Thedefault values can be determined by the manufacturer and can be storedin the memory 118. Additionally, for example, as indicated in FIG. 22aby a dotted line 124, the processor 112 can be able, via evaluations ofcaptured images of the image sensor areas 58 a-d, such as images to bejoined and merged to a total image, respectively, by the processor 112,to improve and update the stored default values in the memory 118. Theprocessor 112 captures, for example, a scene by adjusting themulti-aperture imaging device 150 with current stored default values viathe adjustment means 116, as will be described in more detail below. Forthis, the default values are read out of the memory 118 and used by theadjustment means 116 for channel-individual adjustment. By analyzing theimages of the image sensor areas 58 a-d captured in that way, theprocessor 112 obtains information on how the stored default values justused for capturing are to be modified in the memory 118 in order toresult in a more accurate or improved compliance of the aboveassumptions in the next capturing by using these improved or updateddefault values.

The stored default values can comprise a complete set of adjustmentvalues, i.e., a set of adjustment values for completely adjusting thedevice 150. The same are selected as described above and explained inmore detail below in order to reduce or eliminate specificchannel-individual deviations of the optical characteristics of thechannels from a set characteristic.

It can be the case that the default values include several sets ofadjustment values, such as one per sequence of successive temperatureintervals such that for image capturing that set of adjustment values isused that is actually suitable for a current situation. For this, thecontrol 122 can access or look up the table of allocations betweendefault value sets and different predetermined situations in the memory118. For this access, the control 122 receives sensor data reflectingthe current situation, such as data concerning temperature, pressure,moisture, location of the device 150 in the room and/or a currentacceleration or a current turning rate of the device 150 and determinesfrom this data one of the several default value sets in the memory 118,namely the one allocated to the predetermined situation which is closestto the current situation as described by the sensor data. Sensor datacan also be obtained from the image sensor data of image sensor areas.For example, the control 122 selects a set in the allocated temperatureinterval of which the current temperature falls. The default values ofthe selected set from the memory 118 used for specific image capturingby the adjustment means 116 can then be updated again when the optionalfeedback 124 is used.

The stored default values can be configured, for example, such that ameasure for dispersion of a distribution of one or severalcharacteristics among the optical channels is reduced by controlling theadjustment device by means of the stored default values, namely atransversal deviation of the partial fields of view from a regulardistribution of the partial fields of view, focal lengths of the opticsor depth-of-field distances of the optical channels.

Alternatively, the default values in the control 122 can be determinedwithout any memory 118, namely when, for example, mapping of the currentsensor data on suitable default values is firmly integrated in thecontrol 122. The mapping can be described by a functional contextbetween sensor data and default values. A functional context could beadapted by parameters. The parameters could be adapted via the feedback124.

The memory 118 can, for example, be a non-volatile memory. Possibly, itis a read-only memory but a rewritable memory is also possible. Thecontrol 122 and the processor 112 can be implemented in software,hardware or in programmable hardware. The same can be programs executedon a common microprocessor. The sensors for providing the sensor datafor the control 122 can belong to the device 150, such as, for example,the image sensor areas or can also be external components, such ascomponents of the apparatus incorporated into the device as will bediscussed with reference to the following figures.

In the following, possible implementations for the adjustment means 116will be described. Here, the adjustment means 116 of FIG. 22a can applyto one, several or all of the implementation variations described below.Specific combinations will also be discussed below.

In the shown variation, the adjustment means 116 comprises, for example,one actuator 126 i for each channel 16 i which moves the optics 64 i ofthe respective channel 16 i in axial direction along the optical axis 17i and along the optical path and/or transversal thereto along the z axisand/or the y axis. Alternatively, the actuator 126 i could, for example,also move the image sensor 12 or an individual image sensor area 58 i.Generally, the actuator 126 i could effect a relative movement of imagesensor area 58 i, optics 64 i and/or the respective segment 64 i of thebeam-deflecting means 24.

According to a variation to which FIG. 23a relates, the adjustment means116 comprises a phase changing optical element and a phase changingelement 128 i for each channel 16 i, which can, as indicated in FIG. 23a, be integrated in the respective optics 64 ai (128 i″) into the segment61 i (128 i′″) between image sensor area 58 i and optics 64 i (128 i′)or can be positioned between optics 64 i and beam-deflecting segment 68i (128 i′″), wherein also combinations of the above-mentioned optionsare possible. The phase changing optical element 128 i can, for exampleeffect a location-dependent change of a refractive index, i.e. a localdistribution of the same, such as by liquid crystals. Alternatively oradditionally, the phase-changing optical element 128 i causes a changeof the shape of an optically active surface, such as by using piezoshaving a mechanical effect on flexible fixed transparent materials andcause a deformation or by using an electro-wetting effect. Thephase-changing optical element 128 i″ could, for example change therefractive index of optics 64 i. Alternatively, the phase-changingelement 128 i″ could change a shape of an optical lens area of theoptics 64 i and thereby change the effective refractive force of theoptics 64 i. The phase-changing element 128 i′″ could, for examplegenerate on an optically relevant surface of the segments 68 i, such ason the reflective facet, a sinusoidal phase grid in order to effectvirtual tilting of the respective surface. Similarly, the phase-changingelement 128 i′ or phase-changing element 128 i″ could deflect theoptical axis.

In other words, the phase change effected by the phase-changing opticalelement 128 i could be almost rotationally symmetrical such asrotationally symmetrical around the optical axis 17 i and hence effectin the case 128 i′, for example a change of the focal width of theoptics 64 i.

The phase change effected by the element 128 i could, however, be almostlinear such as linear along the z axis or along the y axis in order toeffect a change of the deflection angle or a deflection of the opticalaxis 17 i in the respective direction.

The rotationally symmetric phase change can be used for focusing and thelinear phase change for a position correction of the partial field ofview of the respective optical channel 16 i.

According to a further variation illustrated in FIG. 23b , theadjustment means 116 comprises one actuator 132 i for each channel 16 i,which changes the segment 68 i, such as the reflecting facet of therespective channel 16 i in its angular orientation with respect to theoptical axis 17 i, i.e. the setting angle β_(x) ^(i). Here, it should benoted that the segment 68 i is not limited to a reflecting facet. Eachsegment 68 i could also be implemented as a prism deflecting thedirection of the optical axis 17 i in the yz plane while the prism ispassed by the optical path of the optical channel 16 i.

For realizing the relative movements by the actuators 126 i and 132 i,respectively, i.e. for generating the movement of the optics 68 i whichcould be configured, for example in a translational manner, as well asfor tilting the segment 68 i by the actuator 132 i and the z axis, forexample, a pneumatic, hydraulic, piezoelectric, thermal, electrostaticor electrodynamic drive or DC or step motor or again a voice-coil drivecould be used.

With renewed reference to FIG. 22a , it is indicated by dotted linesthat the multi-aperture imaging device 150 can optionally include, inaddition to the adjustment means 116, one or several actuators 134 forgenerating a channel global, i.e. for all optical channels 16 a-d equalrelative movement between image sensor 12, optics array 14 andbeam-deflecting means 18. The one or the several additional actuators134 could, as indicated in FIG. 22a , be part of an optionally existingautofocus control 136 (focusing means) and/or an optionally existingimage stabilization control of the multi-aperture imaging device.

A specific example of a device 150 of FIG. 22a supplemented byadditional actuators is shown in FIG. 24. FIG. 24 shows themulti-aperture imaging device 150 of FIG. 22a , wherein the optics 64a-d of the optical channels 16 a-d are mechanically fixed to one anothervia the common carrier 66. Via this common holder it is possible tosubject the optics 64 a-d to a global movement which is the same for allchannels, such as by translational movement of the carrier 66 in the zdirection, i.e. along the line-extension direction of the array 14. Forthis, an actuator 134 a is provided. Thus, the actuator 134 a generatesa translational movement of the optics 64 a-d which is the same for alloptical channels 16 a-d, in that the actuator 134 a subjects the commoncarrier 66 to the translational movement along the x axis. Regarding thetype of actuator 134 a, reference is made to the examples that have beenreferred to with reference to FIGS. 23a and 23b . Further, the device150 comprises an actuator 134 b for channel global, i.e. for all opticalchannels 16 a-d the same changing of the distance of the image sensor 58i to optics 54 i along the x axis and along the optical axis 17 i,respectively. As indicated in FIG. 24, for example the actuator 134 bsubject to optics 64 a-d to the translational movement along the z axisfor changing the distance from the allocated image sensor portions 58a-d not via the carrier 66 but also via the actuator 134, which is thusalso subject to the translational movement along the x axis and actuallyserves as suspension for the carrier 66.

Additionally, the device 150 of FIG. 24 comprises an actuator 134 c forrotating the beam-deflecting means 18 around an axis running parallel tothe z axis and lying in or not far apart from the plane where theoptical axes 17 a-d run. Also concerning actuators 134 b and 134 creference is made to the list of examples provided with reference toFIGS. 23a and 23b above concerning possible implementation examples. Therotational movement exerted by the actuator 134 c on the beam-deflectingmeans 18 has the same or equal effect on the segments 68 a-d on thebeam-deflecting means 18 for all channels 16 a-d, i.e. the same ischannel global.

Via the actuator 134 b, the autofocus control 136 is, for example ableto control the focus of an image by the device 150 by means of thechannels 16 a-d in the channel global sense. The image stabilizationcontrol 138 is able to stabilize the total field of view 72 by means ofthe actuator 134 c in a first direction 142 and by means of the actuator134 a in a direction 144 perpendicular thereto from shaking by a user.The first direction 142 can be obtained by a rotational movement aroundthe axis of rotation 44. As indicated by the first direction 142′,alternatively or additionally, translational movement of thebeam-deflecting means 18 and/or the array 14 can be generated by theactuator 134. Here, the directions 142, 142′ and 144 can be parallel tothe image axis, in one plane of the direction or can correspond to thesame. Image stabilizers described herein can be configured in order tocommonly act for two, a plurality or all optical paths of the opticalchannels. This means that channel individual stabilization can beomitted which is advantageous.

For example, the device 150 of FIG. 22a comprises an actuator for eachchannel 16 a-d, such as an actuator 126 i for each channel 16 i in orderto subject the image sensor segments or areas 58 a-d in a channelindividual manner to a translational movement along the z axis and/oralong the y axis in order to compensate, for example, to a reduction ofinaccuracies or temperature-induced drifts of the partial fields of viewwithin the total field of view. Alternatively or additionally, thedevice 150 of FIG. 22a could comprise an actuator 128 i″ in order tocompensate focal width differences of the optics 64 a-d that haveundesirably occurred caused by production. Additionally oralternatively, the device 150 of FIG. 22a can comprise an actuator 128i′″ in order to compensate deviations of the relative inclinations ofsegments 68 a-d among one another caused by production or temperaturethat developed such that the relative inclinations result in the desiredcoverage of the total field of view 72 by the partial fields of view 74a-d. Additionally or alternatively, the device 150 then can compriseactuators of the types 128 i′ and 128 i′″, respectively.

Again, summarized, the device 150 can comprise an actuator 134 c that isconfigured to rotate the beam-deflecting means 18 around an axis whichis parallel to the line-extension direction z of the array 14. The axisof rotation is, for example in the plane of the optical axes 17 a-d orapart therefrom left by a quarter of a diameter of the optics 64 a-d.Alternatively, it could also be possible that the axis of rotation isfurther apart, such as less than one optics diameter or less than fouroptics diameters. The actuator 134 c can, for example, be provided torotate the beam-deflecting means 18 with a short response time in merelya small angular range, such as within a span of less than 5° or lessthan 10° in order to compensate shakings of the multi-aperture imagingdevice 150, for example by a user, during image capture. In this case,the actuator 134 c would for example be controlled by the imagestabilization control 138.

Alternatively or additionally, the actuator 134 c could be configured tochange the total field of view 72 with greater angular offsets, which isdefined by the total coverage of the partial fields of view 74 a-d (FIG.22a ) in its direction. Here it would further be possible that alsodeflections are obtained by rotating the beam-deflecting means 18 wherethe total field of view is arranged in the opposite direction relativeto the device 150, for example in that the beam-deflecting means 18 isconfigured as a mirror array reflecting on both sides.

Again, alternatively or additionally, the device 150 can comprise anactuator 134 a that is configured to move the optics 64 a-d by means ofthe substrate 66 and the substrate 66 itself and hence the optics 64 a-din a translation manner along the line-extension direction. The actuator134 a could, for example also be controlled by the above-mentioned imagestabilization control in order to obtain, by the movement 96 along theline-extension direction, image stabilization transversely to the imagestabilization realized by the rotation of the mirror deflecting means18.

Further, additionally or alternatively, the device 150 can comprise anactuator 134 b for changing the image side distance between image sensor12 and optics 64 a-d and between the image sensor 12 and a body 66,respectively, to obtain depth of field adjustment, cf. FIG. 19. Themeans 98 can be controlled by a manual user control or by autofocuscontrol of the device 150.

The actuator 134 a serves as a suspension of the substrate 66 and, asindicated in FIG. 22a , the same may be arranged laterally besidessubstrate 66 along the line-extension direction in order to not increasethe installation height. It also applies for actuators 134 b and 134 cthat the same may be arranged in the plane of the optical path in orderto not increase the installation height.

It should be noted that the optics 64 a-d could not only be held withrespect to one another, such as via the above-mentioned transparentsubstrate, but also relative to the beam-deflecting means in a constantrelative position, such as via a suitable frame which advantageouslydoes not increase installation height and hence once advantageously inthe plane of the components 12, 14 and 66 and in the plane of theoptical path, respectively. The consistency of the relative positioncould be limited to the distance between optics and beam-deflectingmeans along the optical axes, such that the actuator 134 b moves, forexample, the optics 64 a-d together with the beam-deflecting means 18 ina translational manner along the optical axes. Theoptics-to-beam-deflecting means distance could be set to a minimumdistance, such that the optical path of the channels is not laterallylimited by segments of the beam-deflecting means 18, which reduces theinstallation height, since otherwise the segments 68 i would have to bedimensioned, as regards to the lateral extension, for the greatestoptics-to-beam-deflecting means distance in order to not limit theoptical path. Additionally, the consistency of the relative positionwould mean that the above mentioned frame holds the optics and thebeam-deflecting means along the z axis in a rigid manner to one another,such that the actuator 134 a would move the optics 64 a-d together withthe beam-deflecting means translationally along the line-extensiondirection.

The above described beam-deflecting means 18 for deflecting the opticalpath of the optical channels allows, together with the actuator 134 cfor generating the rotational movement of the beam-deflecting means 18and the actuator 134 of an optical image stabilization control of themulti-aperture imaging device 150 image and total image fieldstabilization, respectively, in two-dimension, namely by thetranslational movement of the substrate 66 image stabilization along afirst image axis running essentially parallel to the line-extensiondirection and by generating the rotational movement of thebeam-deflecting means 18 image stabilization along a second image axisrunning essentially parallel to the optical axis prior to and withoutbeam deflection, respectively, or, if the deflected optical axes areconsidered, perpendicular to the optical axes and the line-extensiondirection. Additionally, the arrangement described herein can effecttranslational movement of the beam-deflecting means fixed in the stateframe and the array 14 perpendicular to the line-extension directionsuch as by the described actuator 54, which can be used for realizingfocus control and hence autofocus function.

FIG. 25 shows a schematic view of a multi-aperture imaging device 180for illustrating an advantageous arrangement of actuators, such as forimage stabilization and/or for adjusting a focus. The image sensor 12,the array 14 and the beam-deflecting means 18 can span a cuboid inspace. The cuboid can also be considered as virtual cuboid and can have,for example, a minimum volume and in particular a minimum perpendicularextension along a direction parallel to the y direction and a thicknessdirection, respectively, and can include the image sensor 12, thesingle-line array 14 and the beam-deflecting means 18. The minimumvolume can also be considered that the same describes a cuboid spannedby the arrangement and/or operative movement of the image sensor course,the array 14 and/or the beam-deflecting means 18. The array 14 can havea line-extension direction 146 along which the optical channels 16 a and16 b are arranged juxta post, possibly parallel to one another. Theline-extension direction 146 can be arranged stationary in space.

The virtual cuboid can comprise two sides that run opposite parallel toone another, parallel to the line-extension direction 146 of thesingle-line array 14 as well as parallel to part of the optical path 17a and/or 17 b of the optical channels 16 a and 16 b, respectively,between the image sensor 12 and the beam-deflecting means 18. Simplyput, but without any limiting effect, this could, for example, be a topand a bottom of the virtual cuboid. The two sides can span a first plane148 a and a second plane 148 b. This means the two sides of the cuboidscan each be part of the plane 148 a and 148 b, respectively. Furthercomponents of the multi-aperture imaging device can be arrangedcompletely but at least partly inside the area between the planes 148 aand 148 b, such that installation space requirements of themulti-aperture imaging device 180 along a direction parallel to asurface normal of the plane 148 a and/or 148 b is low, which isadvantageous. A volume of the multi-aperture imaging device can have alow or minimum installation space between the planes 148 a and 148 b.Along the lateral sides or extension directions of the planes 148 aand/or 148 b, the installation space of the multi-aperture imagingdevice can be large or of any size. The volume of the virtual cuboid is,for example, influenced by an arrangement of the image sensor 12, thesingle-line array 14 and the beam-deflecting means 18, wherein thearrangement of these components can be performed according to theembodiments described herein such that the installation space of thesecomponents along the direction perpendicular to the planes and hence thedistance of the planes 148 a and 148 b to one another becomes low orminimum. Compared to other arrangements of the components, the volumeand/or the distance of other sides of the virtual cuboid can beenlarged.

The multi-aperture imaging device 180 includes an actuator means 152 forgenerating a relative movement between the image sensor 12, thesingle-line array 14 and the beam-deflecting means 18. The actuatormeans 152 is arranged at least partly between the planes 148 a and 148b. The actuator means 152 can be configured to move at least one of theimage sensor 12, the single-line array 14 or the beam-deflecting means18 rotationally around at least one axis and/or translationally alongone or several directions. For this, the actuator means 152 can compriseat least one actuator, such as the actuator 128 i, 132 i and 134 forchannel individually changing a relative position between the imagesensor area 58 i of a respective optical channel 16 i, the optics 64 iof the respective optical channel 16 i and the beam-deflecting means 18and the respective segment 68 i of the same, respectively, or forchannel individually changing an optical characteristic 16 i or anoptical characteristic of the segment 68 i of the beam-deflecting means18 concerning the deflection of the optical path of the respectiveoptical channel. Alternatively or additionally, the actuator means canimplement autofocus and/or optical image stabilization as describedabove.

The actuator means 152 can have a dimension or extension 154 parallel tothe thickness direction. A proportion of at the most 50%, at the most30% or at the most 10% of the dimension 154 can project beyond the plane148 a and/or 148 b starting from an area between the planes 148 a and148 b or can project from the area. This means that the actuator means152 at the most projects insignificantly beyond the plane 148 a and/or148 b. According to embodiments, the actuator means 152 does not projectbeyond the planes 148 a and 148 b. It is an advantage that an extensionof the multi-aperture imaging device 180 along the thickness directionis not enlarged by the actuator means 152.

Based on FIG. 26a-e , advantageous implementations of a beam-deflectingmeans 18 will be described. The statements show a series of advantagesthat can be executed individually or in any combination, but are not tohave any limiting effect.

FIG. 26a shows a schematic side sectional view of the beam-deflectingelement 172 as it can be used for a beam-deflecting means describedherein, such as the beam-deflecting means 18 of FIGS. 1, 2, 3 a, 3 b, 4a, 4 b, 5, 6 b, 6 c or in devices according to FIGS. 7a and/or 7 b. Theconfiguration, however, can also be combined with the embodiments of thebeam-deflecting means according to the further Figures.

The beam-deflecting element 172 can be effective for one, a plurality orall of the optical channels 16 a-d and can have a polygonalcross-section. Although a triangular cross-section is shown, it can alsobe any other polygon. Alternatively or additionally, the cross-sectioncan also have at least one bent surface, wherein in particular inreflective surfaces a configuration that is planar at least in portionsin order to prevent imaging errors can be advantageous.

The beam-deflecting element 172 comprises, for example, a first side 174a, a second side 174 b and a third side 174 c. At least two sides, suchas the sides 174 a and 174 b are formed reflectively, such that thebeam-deflecting element 172 is reflective on both sides. The sides 174 aand 174 b can be main sides of the beam-deflecting element 172, i.e.sides whose area is greater than the side 174 c.

In other words, the beam-deflecting element 172 can be wedge-shaped andcan be reflective on both sides. A further area can be arranged oppositeto the area 174 c, i.e. between areas 174 a and 174 b, which is,however, significantly smaller than the area 174 c. In other words, thewedge formed by the areas 174 a, b and c is not tapering in any mannerbut is provided with an area on the pointed side and is hence truncated.

FIG. 26b shows a schematic side sectional view of the beam-deflectingelement 172, wherein a suspension or displacement axis 176 of thebeam-deflecting element 172 is described. The displacement axis 176,around which the beam-deflecting element 172 can be rotationally and/ortranslationally moved in the beam-deflecting means 18 can be displacedoff-center with regard to a centroid 178 of the cross-section. Thecentroid can alternatively also be a point describing the dimension ofthe beam-deflecting element 172 in halves along a thickness direction182 and along a direction 184 perpendicular thereto.

The displacement axis can, for example, be unamended along a thicknessdirection 182 and can have any offset in a direction perpendicularthereto. Alternatively, an offset along the thickness direction 182 isalso possible. The displacement can be performed, for example, such thatwhen rotating the beam-deflecting element 172 around the displacementaxis 176, a greater actuator path is obtained than when rotating aroundthe centroid 178. In this way, by displacing the displacement axis 176,the path by which the edge is moved between the sides 174 a and 174 bduring rotation can be increased compared to a rotation around thecentroid 178, with the same angle of rotation. Advantageously, thebeam-deflecting element 172 is arranged such that the edge, i.e., thepointed side of the wedge-shaped cross-section, is facing the imagesensor between sides 174 a and 174 b. By small rotational movements, arespective different side 174 a or 174 b can deflect the optical path ofthe optical channels. Here, it becomes clear that the rotation can beperformed such that spatial requirements of the beam-deflecting meansalong the thickness direction 182 are low since a movement of thebeam-deflecting element 172, such that a main side is perpendicular tothe image sensor, is not necessitated.

The side 174 c can also be referred to as secondary side or rear side.Several beam-deflecting elements can be connected to one another suchthat a connecting element is arranged on the side 174 c or passesthrough the cross-section of the beam-deflecting elements, i.e., isarranged inside the beam-deflecting elements, for example in the area ofthe displacement axis 176. In particular, the holding element can bearranged such that the same projects not or only to a low extent, i.e.,at the most 50%, at the most 30% or at the most 10% beyond thebeam-deflecting element 172 along the direction 182, such that theholding element does not increase or determine the extension of thetotal structure along the direction 182. The extension in the thicknessdirection 182 can alternatively be determined by the lenses of theoptical channels, i.e., the same have the dimension defining the minimumof the thickness.

The beam-deflecting element 172 can be formed of glass, ceramics, glassceramics, plastic, metal or a combination of these materials and/orfurther materials.

In other words, the beam-deflecting element 172 can be arranged suchthat the tip, i.e., the edge between the main sides 174 a and 174 bpoints to the image sensor. Holding of the beam-deflecting elements canbe such that the same are merely held on the rear side or inside thebeam-deflecting elements, i.e., the main sides are not covered. A commonholding or connecting element can extend beyond the rear side 174 c. Theaxis of rotation of the beam-deflecting element 172 can be arrangedoff-center.

FIG. 26c shows a schematic perspective view of a multi-aperture imagingdevice 190 including an image sensor 12 and a single-line array 14 ofjuxtaposed optical channels 16 a-d. The beam-deflecting means 18includes a number of beam-deflecting elements 172 a-d that cancorrespond to the number of optical channels. Alternatively, a lowernumber of beam-deflecting elements can be arranged, for example when atleast one beam-deflecting element is used by two optical channels.Alternatively, a higher number can be arranged, for example whenswitching the deflecting means of the beam-deflecting means 18 isperformed by translational movement as described in the context of FIGS.4a and 4b . Each beam-deflecting element 172 a-d can be allocated to anoptical channel 16 a-d. The beam-deflecting elements 172 a-d can beformed as a plurality of elements 172 according to FIG. 4c and FIG. 4d .Alternatively, at least two, several or all beam-deflecting elements 172a-d can be formed integrally.

FIG. 26d shows a schematic side-sectional view of the beam-deflectingelement 172 in which the cross-section is formed as a free-form area. Inthis way, the side 174 c can comprise a recess 186 allowing mounting ofa holding element, wherein the recess 186 can also be formed asprojecting element, such as a tongue of a groove and tongue system.Further, the cross-section comprises a fourth side 174 d that has asmaller area extension than the main sides 174 a and 174 b and connectsthe same to one another.

FIG. 26e shows a schematic side-sectional view of a firstbeam-deflecting element 172 a and a second beam-deflecting element 172behind the same in the illustration direction. Here, the recesses 186 aand 186 b can be arranged such that the same are essentially congruent,such that an arrangement of a connecting element in the recesses isenabled.

FIG. 26f shows a schematic perspective view of the beam-deflecting means18 including, for example, four beam-deflecting elements 172 a-d thatare connected to a connecting element 188. The connecting element can beused in order to be translationally and/or rotationally moveable by anactuator. The connecting element 188 can be formed integrally and canrun across an extension direction, for example the y-direction in FIG.4e on or in the beam-deflecting elements 172 a-d. Alternatively, theconnecting element 188 can also be merely connected to at least one sideof the beam-deflecting means 18, for example when the beam-deflectingelements 172 a-d are integrally formed. Alternatively, a connection toan actuator and/or a connection of the beam-deflecting elements 172 a-dcan also be established in any other way, for example by means ofadhering, bonding or soldering.

Although some aspects have been described in the context of anapparatus, it is obvious that these aspects also represent a descriptionof the corresponding method, such that a block or device of an apparatusalso corresponds to a respective method step or a feature of a methodstep. Analogously, aspects described in the context of a method stepalso represent a description of a corresponding block or detail orfeature of a corresponding apparatus.

While this invention has been described in terms of several embodiments,there are alterations, permutations, and equivalents which will beapparent to others skilled in the art and which fall within the scope ofthis invention. It should also be noted that there are many alternativeways of implementing the methods and compositions of the presentinvention. It is therefore intended that the following appended claimsbe interpreted as including all such alterations, permutations, andequivalents as fall within the true spirit and scope of the presentinvention.

The invention claimed is:
 1. A multi-aperture imaging device comprising: at least one image sensor; and an array of juxtaposed optical channels, wherein each optical channel comprises optics for projecting at least one partial area of an object area on an image sensor area of the at least one image sensor; a beam deflector for deflecting an optical path of the optical channels in beam-deflecting areas of the beam deflector; wherein the beam deflector is formed as an array of facets arranged along a line-extension direction of the array of optical channels and wherein one facet is allocated to each optical channel and wherein each facet comprises at least one beam-deflecting area; wherein a stray light suppressing structure is arranged between a first beam-deflecting area of a first facet and a second beam-deflecting area of a juxtaposed second facet, which is configured to reduce transition of stray light between the first beam-deflecting area and the second beam-deflecting area.
 2. The multi-aperture imaging device according to claim 1, wherein the stray light suppressing structure is arranged on a main side of the beam deflector.
 3. The multi-aperture imaging device according to claim 1, wherein the stray light suppressing structure is elevated with respect to the topography of the first or second facet.
 4. The multi-aperture imaging device according to claim 1, wherein the stray light suppressing structure comprises a topography with respect to the first or second facets that comprises a polygonal chain.
 5. The multi-aperture imaging device according to claim 4, wherein the polygonal chain comprises a portion that runs essentially parallel to a juxtaposed at least partly transparent cover of the multi-aperture imaging device during operation of the multi-aperture imaging device, wherein the beam deflector is configured to deflect the optical channels through the at least partly transparent cover and wherein the at least partly transparent cover forms a housing part of the multi-aperture imaging device.
 6. The multi-aperture imaging device according to claim 5, wherein the beam deflector comprises a first position and a second position between which the beam deflector is movable, wherein the beam deflector is configured to deflect the optical path of each optical channel in the first position and in the second position in differing directions; wherein the polygonal chain is a first polygonal chain arranged on a first main side of the beam deflector, wherein the at least partly transparent cover is a first at least partly transparent cover that is arranged facing the first main side and wherein a second polygonal chain of the stray light suppressing structure or a further stray light suppressing structure is arranged on a second main side of the beam deflector and runs parallel to a juxtaposed second at least partly transparent cover of the multi-aperture imaging device in the second position, wherein the beam deflector is configured to deflect the optical channels in the second position through the second at least partly transparent cover and wherein the second at least partly transparent cover forms a housing part of the multi-aperture imaging device.
 7. The multi-aperture imaging device according to claim 1, wherein the stray light suppressing structure extends along a direction perpendicular to the line-extension direction on a main side of the beam deflector to an extent of at least 30% of the extension of the beam deflector.
 8. The multi-aperture imaging device according to claim 1, wherein the stray light suppressing structure is formed as continuous structure and extends along a direction perpendicular to the line-extension direction on a main side of the beam deflector to an extent of at least 95% of the extension of the beam deflector.
 9. The multi-aperture imaging device according to claim 1, wherein the stray light suppressing structure comprises at least one of a metal material, a plastic material and/or a semi-conductor material.
 10. The multi-aperture imaging device according to claim 1, wherein the stray light suppressing structure is arranged spaced-apart from a housing of the multi-aperture imaging device in an operating state of the multi-aperture imaging device.
 11. The multi-aperture imaging device according to claim 1, wherein the beam deflector comprises a first position and a second position between which the beam deflector is movable, wherein the beam deflector is configured to deflect the optical path of each optical channel in a differing direction in the first position and in the second position.
 12. The multi-aperture imaging device according to claim 11, wherein the beam deflector is rotationally moveable around an axis of rotation between the first position and the second position.
 13. The multi-aperture imaging device according to claim 11, wherein the beam deflector comprises a first reflective main side and a second reflective main side, wherein in the first position the first reflective side is arranged facing the at least one image sensor and in the second position the second reflective side is arranged facing the at least one image sensor.
 14. The multi-aperture imaging device according to claim 13, wherein the stray light suppressing structure is a first stray light suppressing structure that is arranged on the first main side of the beam deflector, and wherein a third stray light suppressing structure is arranged on the second main side between a third beam-deflecting area of a third facet and a fourth beam-deflecting area of a fourth facet.
 15. The multi-aperture imaging device according to claim 14, wherein the first stray light suppressing structure and the third stray light suppressing structure are formed integrally.
 16. The multi-aperture imaging device according to claim 3, wherein the stray light suppressing structure is a first stray light suppressing structure and is connected to an adjacent second stray light suppressing structure between the second beam-deflecting area and the third beam-deflecting area of a third facet arranged adjacent to the second facet, via a ridge that extends on a side of the beam deflector facing the optics.
 17. The multi-aperture imaging device according to claim 16, wherein the ridge is formed integrally with the first or second stray light suppressing structure.
 18. The multi-aperture imaging device according to claim 16, wherein the ridge is arranged such that the optical path of an optical channel is arranged in an area between the array and the beam deflector between the ridge and an exit side of the multi-aperture imaging device, wherein the exit side is a side of the multi-aperture imaging device through which the optical path passes when the same is deflected by the beam deflector.
 19. The multi-aperture imaging device according to claim 1, wherein the beam deflector is connected to an at least partly transparent cover, wherein the transparent cover is moved at least partly out of the housing during movement of the beam deflector from the first position to the second position, wherein the beam deflector is configured to deflect the optical paths of the optical channels such that the optical channels pass through the transparent cover.
 20. The multi-aperture imaging device according to claim 1, wherein the beam deflector is configured to deflect the optical path of the optical channels in a first position such that the same passes through a first at least partly transparent cover and to deflect the optical path of the optical channels in a second position such that the same passes through a second at least partly transparent area.
 21. The multi-aperture imaging device according to claim 20, wherein a first diaphragm is configured to optically close the first at least partly transparent cover in the second position at least partly, and wherein a second diaphragm is configured to optically close the second at least partly transparent cover in the first position at least partly, at least at times.
 22. The multi-aperture imaging device according to claim 21, wherein the first diaphragm and/or the second diaphragm is formed as electrochromic diaphragm.
 23. The multi-aperture imaging device according to claim 21, wherein a first diaphragm and the second diaphragm is effective for at least two optical channels of the multi-aperture imaging device.
 24. The multi-aperture imaging device according to claim 20, wherein the stray light suppressing structure is arranged in the first position and in the second position of the beam deflector in a contactless manner with respect to a housing of the multi-aperture imaging device.
 25. The multi-aperture imaging device according to claim 1, wherein at least two optical channels are allocated to one facet.
 26. The multi-aperture imaging device according to claim 1, further comprising an optical image stabilizer comprising a joint effect for two, a plurality or all optical paths of the optical channels for image stabilization along a first image axis and a second image axis by generating a translational relative movement between the at least one image sensor and the array or the beam deflector, wherein the translational movement runs parallel to a first image axis and a second image axis of an image captured by the multi-aperture imaging device.
 27. The multi-aperture imaging device according to claim 1, further comprising an optical image stabilizer comprising a joint effect for two, a plurality or all optical paths of the optical channels for image stabilization along a first image axis by generating a translational relative movement between the at least one image sensor and the array and for image stabilization along a second image axis by generating a rotational movement of the beam deflector.
 28. The multi-aperture imaging device according to claim 26, wherein the optical image stabilizer comprises at least one actuator and is arranged such that the same is arranged at least partly between two planes that are spanned by sides of a cuboid, wherein the sides of the cuboid are oriented parallel to one another as well as to a line-extension direction of the array and part of the optical path of the optical channels between the at least one image sensor and the optics and whose volume is minimal and still comprises the at least one image sensor and the array.
 29. The multi-aperture imaging device according to claim 28, wherein the image stabilizer projects by at the most 50% out of an area between the planes.
 30. The multi-aperture imaging device according to claim 1, further comprising a focuser comprising at least one actuator for adjusting a focus of the multi-aperture imaging device that is configured to provide a relative movement between at least one optics of one of the optical channels and the at least one image sensor.
 31. The multi-aperture imaging device according to claim 30, wherein the focuser is arranged such that the same is arranged at least partly between two planes that are spanned by sides of a cuboid, wherein the sides of the cuboid are oriented parallel to one another as well as to a line-extension direction of the array and part of the optical path of the optical channels between the at least one image sensor and the optics and whose volume is minimal and still comprises the at least one image sensor and the array.
 32. The multi-aperture imaging device according to claim 30, wherein the focuser is configured to commonly adjust the focus for all optical channels.
 33. The multi-aperture imaging device according to claim 1, wherein each partial area of the object area is projected on at least two image sensor areas by at least two optical channels.
 34. The multi-aperture imaging device according to claim 1, wherein a total amount of the optical channels of the array projects a total amount of partial areas of the object area on a total amount of image sensor areas of the at least one image sensor and wherein the total amount of the partial areas completely projects the object area to be captured.
 35. The multi-aperture imaging device according to claim 1, wherein the array for capturing the object area is formed as a single line.
 36. An imaging system with a multi-aperture imaging device according to claim
 1. 37. The imaging system according to claim 36, comprising at least a first and at least a second multi-aperture imaging device according to claim
 1. 38. The imaging system according to claim 37, further comprising for the first and second multi-aperture imaging device at least one of: a common image sensor; a common focuser comprising at least one actuator for commonly adjusting a focus of the first and second multi-aperture imaging devices; an optical image stabilizer comprising a joint effect for at least one optical path of the first multi-aperture imaging device and for at least one optical path of the second multi-aperture imaging device for image stabilization along a first image axis and a second image axis by generating a translational relative movement between the common image sensor and the array or the beam deflector of the first or second multi-aperture imaging devices; and a common beam deflector arranged between the array of the first and second multi-aperture imaging devices and the object area and configured to deflect an optical path of the optical channels of the first and second multi-aperture imaging devices.
 39. The imaging system according to claim 38, comprising an optical image stabilizer comprising a joint effect for the at least one optical path of the first multi-aperture imaging device and for the at least one optical path of the second multi-aperture imaging device, wherein the optical image stabilizer is configured to generate a translational relative movement between the common image sensor and the array for image stabilization along a first image axis and to generate a rotational movement of the beam deflector of the first multi-aperture imaging device or the beam deflector of the second multi-aperture imaging device for image stabilization along the second image axis.
 40. The imaging system according to claim 36 that is configured as a mobile phone, smartphone, tablet or monitor.
 41. A method for capturing an object area, comprising: providing an image sensor; projecting an object area with an array of juxtaposed optical channels, wherein each optical channel comprises optics for projecting at least one partial area of an object area on an image sensor area of the image sensor; deflecting an optical path of the optical channels in beam-deflecting areas of a beam deflector that is formed as an array of facets arranged along a line-extension direction of the array of optical channels and wherein one facet is allocated to each optical channel and wherein each facet comprises a beam-deflecting area; and reducing transition of stray light between a first beam-deflecting area of a first facet and a second beam-deflecting area of a second facet by arranging a stray light suppressing structure between the first beam-deflecting area and the second beam-deflecting area. 